2022-06-26T07:02:29.122 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-26T07:02:29.130 INFO:teuthology.results:subset: '8799/100000' 2022-06-26T07:02:29.131 INFO:teuthology.results:seed: '4414' 2022-06-26T08:50:39.791 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-26T08:50:39.815 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-26T20:38:41.174 INFO:teuthology.results:Tests finished! gathering results... 2022-06-26T20:39:13.959 INFO:scrape:Found 309 jobs 2022-06-26T20:39:19.290 INFO:scrape:Found 7 distinct failure reasons 2022-06-26T20:39:19.291 INFO:scrape:Failure: {'smithi192.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-06-26T20:39:19.291 INFO:scrape:5 jobs: ['6899182', '6898996', '6899226', '6899215', '6899247'] 2022-06-26T20:39:19.292 INFO:scrape:suites intersection: ['rados'] 2022-06-26T20:39:19.292 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/default', 'd-balancer/crush-compat', 'fast/normal', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/balancer', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'thrashers/careful', 'thrashers/default', 'thrashers/morepggrow', 'thrashers/pggrow', 'thrashosds-health', 'workloads/cache-snaps}', 'workloads/ec-pool-snaps-few-objects-overwrites}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}'] 2022-06-26T20:39:19.293 INFO:scrape: 2022-06-26T20:39:19.293 INFO:scrape:Failure: 2022-06-26T20:39:19.293 INFO:scrape:1 jobs: ['6899188'] 2022-06-26T20:39:19.294 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/max-pg-per-osd.from-replica', 'supported-random-distro$/{ubuntu_latest}}'] 2022-06-26T20:39:19.294 INFO:scrape: 2022-06-26T20:39:19.295 INFO:scrape:Failure: 'check orch status' reached maximum tries (90) after waiting for 900 seconds 2022-06-26T20:39:19.295 INFO:scrape:4 jobs: ['6899044', '6899120', '6899198', '6898966'] 2022-06-26T20:39:19.295 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', '3-final', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04'] 2022-06-26T20:39:19.296 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}'] 2022-06-26T20:39:19.296 INFO:scrape: 2022-06-26T20:39:19.296 INFO:scrape:Dead: b'2022-06-26T20:34:51.520 DEBUG:teuthology.exit:Finished running handlers' 2022-06-26T20:39:19.297 INFO:scrape:2 jobs: ['6899202', '6899051'] 2022-06-26T20:39:19.297 INFO:scrape:suites intersection: ['rados'] 2022-06-26T20:39:19.298 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'fast/fast', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/singleton/{all/thrash-eio', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-snaps-few-objects-overwrites}'] 2022-06-26T20:39:19.298 INFO:scrape: 2022-06-26T20:39:19.298 INFO:scrape:Failure: Cannot connect to remote host smithi041 2022-06-26T20:39:19.299 INFO:scrape:1 jobs: ['6899002'] 2022-06-26T20:39:19.299 INFO:scrape:suites: ['clusters/{fixed-4', 'mon_election/classic', 'msgr-failures/osd-dispatch-delay', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash-erasure-code-shec/{ceph', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}'] 2022-06-26T20:39:19.300 INFO:scrape: 2022-06-26T20:39:19.300 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d8504d8c8121f09c1af01eacc23e1cc3a58ad29 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2022-06-26T20:39:19.301 INFO:scrape:2 jobs: ['6899096', '6899252'] 2022-06-26T20:39:19.301 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{0-single-container-host', 'tasks/e2e}'] 2022-06-26T20:39:19.301 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-snappy}', 'random-objectstore$/{bluestore-comp-zstd}', 'tasks/e2e}'] 2022-06-26T20:39:19.302 INFO:scrape: 2022-06-26T20:39:19.302 INFO:scrape:Failure: Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi100 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d8504d8c8121f09c1af01eacc23e1cc3a58ad29 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh' 2022-06-26T20:39:19.303 INFO:scrape:1 jobs: ['6899086'] 2022-06-26T20:39:19.303 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'thrashers/sync', 'workloads/rados_mon_osdmap_prune}'] 2022-06-26T20:39:19.303 INFO:scrape: 2022-06-26T20:39:19.312 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/ failed: 9 dead: 7 running: 0 waiting: 0 queued: 0 passed: 293 Fail ================================================================= [6898966] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/flannel rook/1.7.2} ----------------------------------------------------------------- time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898966/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898966/ sentry: https://sentry.ceph.com/organizations/ceph/?query=42f8d27a64404c32b428b4cc56ea71e3 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6899002] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899002/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899002/ sentry: https://sentry.ceph.com/organizations/ceph/?query=abbc569df96d41779c8afa3e3fbe8fa5 Cannot connect to remote host smithi041 [6899044] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:25:58 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899044/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899044/ sentry: https://sentry.ceph.com/organizations/ceph/?query=db438225051442b584f253724860d81a 'check orch status' reached maximum tries (90) after waiting for 900 seconds [6899086] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:39:42 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899086/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899086/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eb1375a80bf04963a790dbcc5b550c3c Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi100 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d8504d8c8121f09c1af01eacc23e1cc3a58ad29 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh' [6899096] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/e2e} ----------------------------------------------------------------- time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899096/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899096/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3aa8eddcb0474150b6938f3ea5823743 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d8504d8c8121f09c1af01eacc23e1cc3a58ad29 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6899120] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:28:17 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899120/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899120/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3894e300f7e64aad8b7742665a7c2da8 'check osd count' reached maximum tries (90) after waiting for 900 seconds [6899188] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:24:06 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899188/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899188/ sentry: https://sentry.ceph.com/organizations/ceph/?query=996ae1776d094a939c1d5c4aa0745cdc [6899198] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899198/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899198/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ac9a89f9e0649ab8e5de6b7bc4e9f4b 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6899252] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e} ----------------------------------------------------------------- time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899252/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899252/ sentry: https://sentry.ceph.com/organizations/ceph/?query=52e2a5c8161e4b04948fecf6fd7e5305 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi036 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6d8504d8c8121f09c1af01eacc23e1cc3a58ad29 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' Dead ================================================================= [6898996] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:04:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898996/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898996/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc01893cf75b408bb512ad3f9213c933 {'smithi098.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6899051] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899051/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899051/ hit max job timeout [6899182] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:02:40 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899182/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899182/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d21295675c24554a9daf0e4d05d8e3b {'smithi192.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6899202] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899202/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899202/ hit max job timeout [6899215] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:04:18 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899215/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899215/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9b62a2660bc47898035d7ae5f85ae30 {'smithi192.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi052.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6899226] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:03:53 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899226/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6cee64aa399b4c3da153fb8dd82e6b1f {'smithi044.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6899247] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899247/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899247/ sentry: https://sentry.ceph.com/organizations/ceph/?query=acc121b6c9fb4bbb854969c489a3da83 {'smithi066.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} Pass ================================================================= [6898959] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:23:57 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898959/ [6898960] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898960/ [6898961] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} time: 02:18:03 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898961/ [6898962] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:30:25 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898962/ [6898963] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:28:41 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898963/ [6898964] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898964/ [6898965] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:47 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898965/ [6898967] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898967/ [6898968] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:01 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898968/ [6898969] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:22:56 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898969/ [6898970] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898970/ [6898971] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898971/ [6898972] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:07:21 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898972/ [6898973] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898973/ [6898974] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898974/ [6898975] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:27:35 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898975/ [6898976] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:19:57 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898976/ [6898977] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898977/ [6898978] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:25:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898978/ [6898979] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:17:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898979/ [6898980] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:19:59 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898980/ [6898981] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:19:33 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898981/ [6898982] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:23:32 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898982/ [6898983] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:17:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898983/ [6898984] rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} time: 02:26:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898984/ [6898985] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:23 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898985/ [6898986] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898986/ [6898987] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:37:30 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898987/ [6898988] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898988/ [6898989] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:26:19 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898989/ [6898990] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8}} time: 00:30:46 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898990/ [6898991] rados/cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898991/ [6898992] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:50 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898992/ [6898993] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:59 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898993/ [6898994] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete} time: 00:18:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898994/ [6898995] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:06 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898995/ [6898997] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898997/ [6898998] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/dedup-io-mixed} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898998/ [6898999] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6898999/ [6899000] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899000/ [6899001] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:28:49 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899001/ [6899003] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:18:43 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899003/ [6899004] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:25:21 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899004/ [6899005] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899005/ [6899006] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-snaps} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899006/ [6899007] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:46:59 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899007/ [6899008] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899008/ [6899009] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899009/ [6899010] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899010/ [6899011] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:06:57 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899011/ [6899012] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:24:22 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899012/ [6899013] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/dashboard} time: 01:23:01 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899013/ [6899014] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:09:33 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899014/ [6899015] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899015/ [6899016] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899016/ [6899017] rados/standalone/{supported-random-distro$/{rhel_8} workloads/c2c} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899017/ [6899018] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:16:57 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899018/ [6899019] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:42 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899019/ [6899020] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:22:32 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899020/ [6899021] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899021/ [6899022] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899022/ [6899023] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 01:35:29 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899023/ [6899024] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_5925} time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899024/ [6899025] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899025/ [6899026] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:39 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899026/ [6899027] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:40:16 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899027/ [6899028] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:34:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899028/ [6899029] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:37 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899029/ [6899030] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899030/ [6899031] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899031/ [6899032] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899032/ [6899033] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:09:57 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899033/ [6899034] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899034/ [6899035] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899035/ [6899036] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899036/ [6899037] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:45 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899037/ [6899038] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899038/ [6899039] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:15:17 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899039/ [6899040] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:39:06 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899040/ [6899041] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:32:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899041/ [6899042] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899042/ [6899043] rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899043/ [6899045] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 01:23:13 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899045/ [6899046] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899046/ [6899047] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:30:43 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899047/ [6899048] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899048/ [6899049] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899049/ [6899050] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899050/ [6899052] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:37 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899052/ [6899053] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/prometheus} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899053/ [6899054] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:59 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899054/ [6899055] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899055/ [6899056] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_api_tests} time: 00:28:22 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899056/ [6899057] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:22 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899057/ [6899058] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:58 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899058/ [6899059] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899059/ [6899060] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:51 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899060/ [6899061] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:37 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899061/ [6899062] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:32 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899062/ [6899063] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:19:12 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899063/ [6899064] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899064/ [6899065] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:04:27 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899065/ [6899066] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899066/ [6899067] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899067/ [6899068] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:19:28 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899068/ [6899069] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:27:03 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899069/ [6899070] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899070/ [6899071] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899071/ [6899072] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899072/ [6899073] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:30:39 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899073/ [6899074] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899074/ [6899075] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899075/ [6899076] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:09:02 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899076/ [6899077] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899077/ [6899078] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899078/ [6899079] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:52 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899079/ [6899080] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:12 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899080/ [6899081] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:29 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899081/ [6899082] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899082/ [6899083] rados/cephadm/workunits/{agent/on mon_election/classic task/test_nfs} time: 00:34:17 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899083/ [6899084] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899084/ [6899085] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/workunits} time: 00:10:12 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899085/ [6899087] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899087/ [6899088] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899088/ [6899089] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899089/ [6899090] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:24:51 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899090/ [6899091] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899091/ [6899092] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:27:02 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899092/ [6899093] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899093/ [6899094] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899094/ [6899095] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899095/ [6899097] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:36 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899097/ [6899098] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899098/ [6899099] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899099/ [6899100] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899100/ [6899101] rados/singleton/{all/deduptool mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:50 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899101/ [6899102] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:25:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899102/ [6899103] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:39:52 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899103/ [6899104] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899104/ [6899105] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899105/ [6899106] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_orch_cli} time: 00:17:20 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899106/ [6899107] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:30 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899107/ [6899108] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:29:35 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899108/ [6899109] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899109/ [6899110] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899110/ [6899111] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:20:37 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899111/ [6899112] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:28:24 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899112/ [6899113] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899113/ [6899114] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:30 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899114/ [6899115] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} time: 00:19:42 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899115/ [6899116] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:26:41 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899116/ [6899117] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:26 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899117/ [6899118] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899118/ [6899119] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899119/ [6899121] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899121/ [6899122] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:51 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899122/ [6899123] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899123/ [6899124] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899124/ [6899125] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899125/ [6899126] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899126/ [6899127] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:25:09 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899127/ [6899128] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899128/ [6899129] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899129/ [6899130] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:23:15 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899130/ [6899131] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899131/ [6899132] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 01:58:31 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899132/ [6899133] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:20:14 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899133/ [6899134] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:51:08 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899134/ [6899135] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:41:16 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899135/ [6899136] rados/cephadm/workunits/{agent/off mon_election/classic task/test_adoption} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899136/ [6899137] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899137/ [6899138] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:02:38 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899138/ [6899139] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:53 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899139/ [6899140] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899140/ [6899141] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899141/ [6899142] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899142/ [6899143] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:27:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899143/ [6899144] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899144/ [6899145] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899145/ [6899146] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:06 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899146/ [6899147] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} time: 00:31:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899147/ [6899148] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899148/ [6899149] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:23 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899149/ [6899150] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899150/ [6899151] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:40 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899151/ [6899152] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/failover} time: 00:14:04 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899152/ [6899153] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899153/ [6899154] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:04:29 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899154/ [6899155] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899155/ [6899156] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899156/ [6899157] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:28:16 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899157/ [6899158] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:59:16 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899158/ [6899159] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:26 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899159/ [6899160] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:22:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899160/ [6899161] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:05:54 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899161/ [6899162] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899162/ [6899163] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 01:14:37 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899163/ [6899164] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:08:06 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899164/ [6899165] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899165/ [6899166] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899166/ [6899167] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:25:07 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899167/ [6899168] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899168/ [6899169] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899169/ [6899170] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:08 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899170/ [6899171] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/dashboard} time: 01:16:52 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899171/ [6899172] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899172/ [6899173] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:17:33 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899173/ [6899174] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899174/ [6899175] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:23:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899175/ [6899176] rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm_repos} time: 00:04:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899176/ [6899177] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899177/ [6899178] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/one workloads/pool-create-delete} time: 00:18:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899178/ [6899179] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:04 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899179/ [6899180] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:34 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899180/ [6899181] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899181/ [6899183] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899183/ [6899184] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899184/ [6899185] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899185/ [6899186] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899186/ [6899187] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/insights} time: 00:14:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899187/ [6899189] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:32:46 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899189/ [6899190] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899190/ [6899191] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899191/ [6899192] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 01:10:48 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899192/ [6899193] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 00:45:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899193/ [6899194] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899194/ [6899195] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899195/ [6899196] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899196/ [6899197] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899197/ [6899199] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899199/ [6899200] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899200/ [6899201] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899201/ [6899203] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:18:51 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899203/ [6899204] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:30:37 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899204/ [6899205] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:44 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899205/ [6899206] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_nfs} time: 00:34:14 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899206/ [6899207] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:20 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899207/ [6899208] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:13 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899208/ [6899209] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:13:57 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899209/ [6899210] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_5925} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899210/ [6899211] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:33 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899211/ [6899212] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:08 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899212/ [6899213] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899213/ [6899214] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899214/ [6899216] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:18:02 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899216/ [6899217] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899217/ [6899218] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:08 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899218/ [6899219] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:08:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899219/ [6899220] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899220/ [6899221] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:34:32 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899221/ [6899222] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:21:57 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899222/ [6899223] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:17:22 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899223/ [6899224] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899224/ [6899225] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 04:28:10 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899225/ [6899227] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899227/ [6899228] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:42:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899228/ [6899229] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:16 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899229/ [6899230] rados/cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} time: 00:17:07 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899230/ [6899231] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:27:07 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899231/ [6899232] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:07:57 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899232/ [6899233] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899233/ [6899234] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899234/ [6899235] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:32:00 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899235/ [6899236] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} time: 00:31:37 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899236/ [6899237] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:28:34 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899237/ [6899238] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:04 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899238/ [6899239] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:49 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899239/ [6899240] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:20:31 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899240/ [6899241] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899241/ [6899242] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899242/ [6899243] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899243/ [6899244] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899244/ [6899245] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}} time: 02:12:17 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899245/ [6899246] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899246/ [6899248] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:34:36 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899248/ [6899249] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899249/ [6899250] rados/singleton/{all/peer mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:08:14 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899250/ [6899251] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_adoption} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899251/ [6899253] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899253/ [6899254] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:22:27 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899254/ [6899255] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:26:19 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899255/ [6899256] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899256/ [6899257] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899257/ [6899258] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:13:56 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899258/ [6899259] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899259/ [6899260] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:10:19 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899260/ [6899261] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:30:07 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899261/ [6899262] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899262/ [6899263] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899263/ [6899264] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:28 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899264/ [6899265] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899265/ [6899266] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899266/ [6899267] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 02:57:51 info: http://pulpito.ceph.com/teuthology-2022-06-26_07:01:04-rados-quincy-distro-default-smithi/6899267/