2022-09-18T17:07:45.332 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-18T17:07:45.335 INFO:teuthology.results:subset: '12603/100000' 2022-09-18T17:07:45.335 INFO:teuthology.results:seed: '3731' 2022-09-18T22:27:57.185 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-18T22:27:57.216 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-09-19T00:26:07.723 INFO:teuthology.results:Tests finished! gathering results... 2022-09-19T00:26:31.621 INFO:scrape:Found 308 jobs 2022-09-19T00:26:34.649 INFO:scrape:Found 8 distinct failure reasons 2022-09-19T00:26:34.650 INFO:scrape:Failure: "2022-09-18T21:27:53.722237+0000 osd.2 (osd.2) 20 : cluster [ERR] osd.2 found snap mapper error on pg 3.5s2 oid 3:a8cc281a:::smithi04741437-44:151 snaps missing in mapper, should be: 14b was r -2...repaired" in cluster log 2022-09-19T00:26:34.651 INFO:scrape:1 jobs: ['7036952'] 2022-09-19T00:26:34.651 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/fastclose', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{default}', 'supported-random-distro$/{rhel_8}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}'] 2022-09-19T00:26:34.652 INFO:scrape: 2022-09-19T00:26:34.652 INFO:scrape:Failure: expected valgrind issues and found none 2022-09-19T00:26:34.653 INFO:scrape:2 jobs: ['7036792', '7036895'] 2022-09-19T00:26:34.653 INFO:scrape:suites intersection: ['centos_latest}', 'rados/valgrind-leaks/{1-start'] 2022-09-19T00:26:34.654 INFO:scrape:suites union: ['2-inject-leak/mon', '2-inject-leak/osd', 'centos_latest}', 'rados/valgrind-leaks/{1-start'] 2022-09-19T00:26:34.654 INFO:scrape: 2022-09-19T00:26:34.655 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi178.front.sepia.ceph.com: ['type=AVC msg=audit(1663522732.788:7170): avc: denied { ioctl } for pid=56907 comm="iptables" path="/var/lib/containers/storage/overlay/8f51281df2022006a0739e99c29a973f50dcbcfb6fc30793981f2e496f0717a4/merged" dev="overlay" ino=3803240 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-09-19T00:26:34.655 INFO:scrape:1 jobs: ['7036746'] 2022-09-19T00:26:34.656 INFO:scrape:suites: ['agent/off', 'mon_election/classic', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-09-19T00:26:34.656 INFO:scrape: 2022-09-19T00:26:34.657 INFO:scrape:Failure: Command failed on smithi049 with status 22: 'kubectl -n rook-ceph exec rook-ceph-tools-7564bb9799-pg9pw -- ceph orch apply osd --all-available-devices' 2022-09-19T00:26:34.657 INFO:scrape:1 jobs: ['7036888'] 2022-09-19T00:26:34.657 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '3-final', 'cluster/3-node', 'k8s/1.21', 'net/flannel', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-09-19T00:26:34.658 INFO:scrape: 2022-09-19T00:26:34.659 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi018 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dafdf93eb3de9fc0597a7334bdd20bbf4d03a23d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2022-09-19T00:26:34.659 INFO:scrape:1 jobs: ['7036969'] 2022-09-19T00:26:34.660 INFO:scrape:suites: ['debug/mgr', 'mon_election/connectivity', 'rados/dashboard/{0-single-container-host', 'random-objectstore$/{bluestore-comp-lz4}', 'tasks/e2e}'] 2022-09-19T00:26:34.660 INFO:scrape: 2022-09-19T00:26:34.660 INFO:scrape:Failure: "2022-09-18T21:06:08.945632+0000 osd.9 (osd.9) 27 : cluster [ERR] 3.16s0 scrub : stat mismatch, got 9/8 objects, 5/4 clones, 9/8 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 1/1 whiteouts, 18546688/16252928 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes." in cluster log 2022-09-19T00:26:34.661 INFO:scrape:1 jobs: ['7036922'] 2022-09-19T00:26:34.661 INFO:scrape:suites: ['cluster/{12-osds', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'recovery-overrides/{more-active-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}'] 2022-09-19T00:26:34.662 INFO:scrape: 2022-09-19T00:26:34.663 INFO:scrape:Failure: Command failed on smithi152 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' 2022-09-19T00:26:34.663 INFO:scrape:2 jobs: ['7036815', '7036968'] 2022-09-19T00:26:34.663 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}'] 2022-09-19T00:26:34.664 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'k8s/1.21', 'net/calico', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}'] 2022-09-19T00:26:34.664 INFO:scrape: 2022-09-19T00:26:34.665 INFO:scrape:Failure: 'wait for operator' reached maximum tries (90) after waiting for 900 seconds 2022-09-19T00:26:34.665 INFO:scrape:1 jobs: ['7036737'] 2022-09-19T00:26:34.666 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'k8s/1.21', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-09-19T00:26:34.666 INFO:scrape: 2022-09-19T00:26:34.676 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/ failed: 10 dead: 0 running: 0 waiting: 0 queued: 0 passed: 298 Fail ================================================================= [7036737] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036737/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036737/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b4326174a524fdf9e1517c106ce5415 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [7036746] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036746/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036746/ SELinux denials found on ubuntu@smithi178.front.sepia.ceph.com: ['type=AVC msg=audit(1663522732.788:7170): avc: denied { ioctl } for pid=56907 comm="iptables" path="/var/lib/containers/storage/overlay/8f51281df2022006a 0739e99c29a973f50dcbcfb6fc30793981f2e496f0717a4/merged" dev="overlay" ino=3803240 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7036792] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} ----------------------------------------------------------------- time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036792/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036792/ expected valgrind issues and found none [7036815] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:04:53 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036815/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036815/ sentry: https://sentry.ceph.com/organizations/ceph/?query=44cd067ae0f2435f977f200472199a48 Command failed on smithi152 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' [7036888] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/flannel rook/master} ----------------------------------------------------------------- time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036888/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036888/ sentry: https://sentry.ceph.com/organizations/ceph/?query=52532ef3b18243a5906e00690ae19e40 Command failed on smithi049 with status 22: 'kubectl -n rook-ceph exec rook-ceph-tools-7564bb9799-pg9pw -- ceph orch apply osd --all-available- devices' [7036895] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} ----------------------------------------------------------------- time: 00:17:51 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036895/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036895/ expected valgrind issues and found none [7036922] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:31:24 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036922/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036922/ "2022-09-18T21:06:08.945632+0000 osd.9 (osd.9) 27 : cluster [ERR] 3.16s0 scrub : stat mismatch, got 9/8 objects, 5/4 clones, 9/8 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 1/1 whiteouts, 18546688/16252928 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes." in cluster log [7036952] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:25:52 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036952/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036952/ "2022-09-18T21:27:53.722237+0000 osd.2 (osd.2) 20 : cluster [ERR] osd.2 found snap mapper error on pg 3.5s2 oid 3:a8cc281a:::smithi04741437-44:151 snaps missing in mapper, should be: 14b was r -2...repaired" in cluster log [7036968] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:04:35 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036968/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036968/ sentry: https://sentry.ceph.com/organizations/ceph/?query=566608c91ede410b900b6f60fc971da5 Command failed on smithi190 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' [7036969] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} tasks/e2e} ----------------------------------------------------------------- time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036969/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036969/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f1f05032eeb74f2ebf70c6b562d1d8a6 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi018 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=dafdf93eb3de9fc0597a7334bdd20bbf4d03a23d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' Pass ================================================================= [7036723] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_adoption} time: 00:07:11 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036723/ [7036724] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:05:31 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036724/ [7036725] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:07:48 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036725/ [7036726] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:17:42 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036726/ [7036727] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036727/ [7036728] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036728/ [7036729] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:34:36 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036729/ [7036730] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036730/ [7036731] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036731/ [7036732] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036732/ [7036733] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036733/ [7036734] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:42 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036734/ [7036735] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:30 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036735/ [7036736] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036736/ [7036738] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036738/ [7036739] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:12:47 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036739/ [7036740] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:16:29 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036740/ [7036741] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:17:47 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036741/ [7036742] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:09 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036742/ [7036743] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036743/ [7036744] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} time: 02:10:20 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036744/ [7036745] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:42 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036745/ [7036747] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:18:13 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036747/ [7036748] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:48:45 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036748/ [7036749] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:08 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036749/ [7036750] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:57 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036750/ [7036751] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036751/ [7036752] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/prometheus} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036752/ [7036753] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036753/ [7036754] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036754/ [7036755] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036755/ [7036756] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:05 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036756/ [7036757] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:23:37 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036757/ [7036758] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036758/ [7036759] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 01:03:18 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036759/ [7036760] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:14:56 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036760/ [7036761] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036761/ [7036762] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:16:58 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036762/ [7036763] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036763/ [7036764] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036764/ [7036765] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:25:04 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036765/ [7036766] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:10:42 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036766/ [7036767] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036767/ [7036768] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:36 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036768/ [7036769] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:07:43 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036769/ [7036770] rados/singleton/{all/peer mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:08:08 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036770/ [7036771] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:24:35 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036771/ [7036772] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:08:04 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036772/ [7036773] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:04:48 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036773/ [7036774] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036774/ [7036775] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:19:03 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036775/ [7036776] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036776/ [7036777] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:08:46 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036777/ [7036778] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036778/ [7036779] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:27:48 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036779/ [7036780] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:23:42 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036780/ [7036781] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036781/ [7036782] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036782/ [7036783] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:09:20 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036783/ [7036784] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/workunits} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036784/ [7036785] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:29:24 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036785/ [7036786] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-mixed} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036786/ [7036787] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:14:46 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036787/ [7036788] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036788/ [7036789] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036789/ [7036790] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:42 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036790/ [7036791] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} time: 04:22:43 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036791/ [7036793] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036793/ [7036794] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:06 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036794/ [7036795] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/dedup-io-snaps} time: 00:09:13 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036795/ [7036796] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_nfs} time: 00:27:47 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036796/ [7036797] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:56 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036797/ [7036798] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:25 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036798/ [7036799] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036799/ [7036800] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036800/ [7036801] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:22:11 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036801/ [7036802] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:31:03 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036802/ [7036803] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} time: 00:51:34 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036803/ [7036804] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:33:14 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036804/ [7036805] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:16:13 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036805/ [7036806] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:09:35 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036806/ [7036807] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036807/ [7036808] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:49:26 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036808/ [7036809] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:15:30 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036809/ [7036810] rados/singleton/{all/random-eio mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:25:58 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036810/ [7036811] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:41 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036811/ [7036812] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036812/ [7036813] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:24:46 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036813/ [7036814] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036814/ [7036816] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e} time: 00:20:45 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036816/ [7036817] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036817/ [7036818] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:14:37 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036818/ [7036819] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036819/ [7036820] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:28:59 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036820/ [7036821] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036821/ [7036822] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036822/ [7036823] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:13:05 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036823/ [7036824] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036824/ [7036825] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:19:28 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036825/ [7036826] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 01:06:28 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036826/ [7036827] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:23:01 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036827/ [7036828] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036828/ [7036829] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036829/ [7036830] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:25:26 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036830/ [7036831] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:29:21 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036831/ [7036832] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036832/ [7036833] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036833/ [7036834] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036834/ [7036835] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:53 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036835/ [7036836] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:35:38 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036836/ [7036837] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 00:56:47 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036837/ [7036838] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036838/ [7036839] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036839/ [7036840] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} time: 02:09:53 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036840/ [7036841] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036841/ [7036842] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:29:19 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036842/ [7036843] rados/singleton/{all/test-crash mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036843/ [7036844] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:51 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036844/ [7036845] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:17:55 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036845/ [7036846] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/classic task/test_adoption} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036846/ [7036847] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036847/ [7036848] rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036848/ [7036849] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:38 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036849/ [7036850] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:17:28 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036850/ [7036851] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036851/ [7036852] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:51 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036852/ [7036853] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036853/ [7036854] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036854/ [7036855] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:17:48 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036855/ [7036856] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036856/ [7036857] rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} time: 02:42:31 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036857/ [7036858] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:18 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036858/ [7036859] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:05 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036859/ [7036860] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:23 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036860/ [7036861] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:38:09 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036861/ [7036862] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 01:15:15 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036862/ [7036863] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036863/ [7036864] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{rhel_8}} time: 00:29:51 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036864/ [7036865] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 02:11:01 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036865/ [7036866] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/valgrind} time: 00:26:29 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036866/ [7036867] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:11 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036867/ [7036868] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:20 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036868/ [7036869] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036869/ [7036870] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:25:48 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036870/ [7036871] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:40:12 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036871/ [7036872] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:36:03 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036872/ [7036873] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:05:58 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036873/ [7036874] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036874/ [7036875] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036875/ [7036876] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036876/ [7036877] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036877/ [7036878] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036878/ [7036879] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/insights} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036879/ [7036880] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036880/ [7036881] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:16 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036881/ [7036882] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:02 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036882/ [7036883] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:22:46 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036883/ [7036884] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:19:36 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036884/ [7036885] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036885/ [7036886] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:08 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036886/ [7036887] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} time: 00:04:44 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036887/ [7036889] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} tasks/dashboard} time: 01:13:19 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036889/ [7036890] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036890/ [7036891] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036891/ [7036892] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:43 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036892/ [7036893] rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036893/ [7036894] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:16:52 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036894/ [7036896] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:21:28 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036896/ [7036897] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:08:57 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036897/ [7036898] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:05 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036898/ [7036899] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:18:03 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036899/ [7036900] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/lockdep} time: 00:23:27 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036900/ [7036901] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036901/ [7036902] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:08:46 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036902/ [7036903] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:14:04 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036903/ [7036904] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync workloads/pool-create-delete} time: 00:13:57 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036904/ [7036905] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036905/ [7036906] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:05:21 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036906/ [7036907] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:32:47 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036907/ [7036908] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:19:50 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036908/ [7036909] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036909/ [7036910] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036910/ [7036911] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036911/ [7036912] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:22:22 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036912/ [7036913] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036913/ [7036914] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:25 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036914/ [7036915] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:21:01 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036915/ [7036916] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:32:24 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036916/ [7036917] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:40 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036917/ [7036918] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:05:59 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036918/ [7036919] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:26 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036919/ [7036920] rados/singleton/{all/deduptool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:09:37 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036920/ [7036921] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} time: 00:25:02 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036921/ [7036923] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:10 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036923/ [7036924] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036924/ [7036925] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036925/ [7036926] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:25:53 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036926/ [7036927] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/valgrind} time: 02:15:30 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036927/ [7036928] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:19:34 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036928/ [7036929] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:21:34 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036929/ [7036930] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:08:20 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036930/ [7036931] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:05 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036931/ [7036932] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} time: 00:20:59 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036932/ [7036933] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:19:49 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036933/ [7036934] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_5925} time: 00:08:18 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036934/ [7036935] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036935/ [7036936] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:24:19 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036936/ [7036937] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036937/ [7036938] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:06 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036938/ [7036939] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:13 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036939/ [7036940] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036940/ [7036941] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:48 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036941/ [7036942] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036942/ [7036943] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036943/ [7036944] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036944/ [7036945] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:28:14 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036945/ [7036946] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/progress} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036946/ [7036947] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:46 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036947/ [7036948] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:07:11 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036948/ [7036949] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:30:26 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036949/ [7036950] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:57:33 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036950/ [7036951] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036951/ [7036953] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:29 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036953/ [7036954] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:35:17 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036954/ [7036955] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:04 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036955/ [7036956] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/mon_recovery validater/lockdep} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036956/ [7036957] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:18:08 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036957/ [7036958] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:33 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036958/ [7036959] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:05:43 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036959/ [7036960] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:44 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036960/ [7036961] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:08 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036961/ [7036962] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036962/ [7036963] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:24:54 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036963/ [7036964] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_api_tests} time: 00:34:48 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036964/ [7036965] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036965/ [7036966] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:52:03 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036966/ [7036967] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:05:13 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036967/ [7036970] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036970/ [7036971] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:18:15 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036971/ [7036972] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036972/ [7036973] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036973/ [7036974] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036974/ [7036975] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:11:20 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036975/ [7036976] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:34:41 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036976/ [7036977] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:31:02 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036977/ [7036979] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:15:21 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036979/ [7036981] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036981/ [7036983] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036983/ [7036985] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:01 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036985/ [7036987] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036987/ [7036989] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036989/ [7036991] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 01:20:02 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036991/ [7036993] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:22:11 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036993/ [7036995] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036995/ [7036997] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036997/ [7036999] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/valgrind} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7036999/ [7037001] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:22:34 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037001/ [7037003] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:40 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037003/ [7037005] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:08:44 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037005/ [7037007] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037007/ [7037009] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 00:51:27 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037009/ [7037011] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:21:48 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037011/ [7037013] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:27:30 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037013/ [7037015] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:19:22 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037015/ [7037017] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:28 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037017/ [7037019] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037019/ [7037021] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:17:18 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037021/ [7037023] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037023/ [7037025] rados/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} time: 00:15:41 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037025/ [7037027] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:23:31 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037027/ [7037029] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037029/ [7037031] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:23:49 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037031/ [7037033] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037033/ [7037035] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037035/ [7037037] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:21:29 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037037/ [7037039] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037039/ [7037041] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037041/ [7037043] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037043/ [7037045] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:02 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037045/ [7037047] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:11 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037047/ [7037049] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:17:18 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037049/ [7037051] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:08:57 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037051/ [7037053] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{centos_8} tasks/workunits} time: 00:08:03 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037053/ [7037055] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:56 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037055/ [7037057] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037057/ [7037059] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/lockdep} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037059/ [7037061] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:32:47 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037061/ [7037063] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037063/ [7037065] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037065/ [7037066] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037066/ [7037069] rados/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:03:49 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037069/ [7037071] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037071/ [7037073] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:12 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037073/ [7037075] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:24:50 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037075/ [7037077] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037077/ [7037079] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037079/ [7037081] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037081/ [7037083] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:57:14 info: http://pulpito.ceph.com/teuthology-2022-09-18_07:01:04-rados-quincy-distro-default-smithi/7037083/