2022-07-10T07:03:01.199 INFO:root:teuthology version: 1.1.1.dev381+g10062088 2022-07-10T07:03:01.202 INFO:teuthology.results:subset: '15322/100000' 2022-07-10T07:03:01.203 INFO:teuthology.results:seed: '3466' 2022-07-10T10:07:09.042 INFO:root:teuthology version: 1.1.1.dev381+g10062088 2022-07-10T10:07:09.078 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-10T14:21:31.468 INFO:teuthology.results:Tests finished! gathering results... 2022-07-10T14:21:57.258 INFO:scrape:Found 309 jobs 2022-07-10T14:22:04.310 INFO:scrape:Found 6 distinct failure reasons 2022-07-10T14:22:04.312 INFO:scrape:Failure: {'smithi167.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi163.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-07-10T14:22:04.312 INFO:scrape:80 jobs 2022-07-10T14:22:04.313 INFO:scrape:suites intersection: [] 2022-07-10T14:22:04.314 INFO:scrape:suites union: ['0-nvme-loop', '0-start', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '1-start', '1-tasks', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '2-services/rgw', '3-final}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'agent/off', 'agent/on', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'debug/mgr', 'fast/fast', 'fast/normal', 'fixed-2', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8}', 'rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/21', 'rados/multimon/{clusters/3', 'rados/multimon/{clusters/9', 'rados/objectstore/{backends/fusestore', 'rados/objectstore/{backends/objectstore-bluestore-b', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/singleton-nomsgr/{all/export-after-evict', 'rados/singleton-nomsgr/{all/full-tiering', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/msgr', 'rados/singleton-nomsgr/{all/osd_stale_reads', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/admin-socket', 'rados/singleton/{all/divergent_priors', 'rados/singleton/{all/ec-inconsistent-hinfo', 'rados/singleton/{all/ec-lost-unfound', 'rados/singleton/{all/lost-unfound', 'rados/singleton/{all/max-pg-per-osd.from-primary', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/pg-autoscaler-progress-off', 'rados/singleton/{all/radostool', 'rados/singleton/{all/random-eio', 'rados/singleton/{all/recovery-preemption', 'rados/standalone/{supported-random-distro$/{rhel_8}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_3.0}', 'rados_api', 'rados_loadgenbig', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-stupid}', 'rbd_import_export', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'start}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/failover}', 'tasks/libcephsqlite}', 'tasks/mon_clock_no_skews}', 'tasks/mon_recovery}', 'tasks/progress}', 'tasks/rados_python}', 'tasks/rados_stress_watch}', 'tasks/repair_test}', 'tasks/workunits}', 'test_rbd_api', 'test_rbd_python}}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/force-sync-many', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/one', 'thrashers/pggrow', 'thrashers/sync-many', 'thrashosds-health', 'upgrade-sequence', 'workload/{ec-rados-default', 'workloads/dedup-io-mixed}', 'workloads/ec-pool-snaps-few-objects-overwrites}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=3-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects-fast-read-overwrites}', 'workloads/ec-small-objects-many-deletes}', 'workloads/ec-small-objects-overwrites}', 'workloads/mon}', 'workloads/pool-create-delete}', 'workloads/rados_5925}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/radosbench-high-concurrency}', 'workloads/redirect_promote_tests}', 'workloads/redirect_set_object}', 'workloads/small-objects-localized}', 'workloads/small-objects}'] 2022-07-10T14:22:04.314 INFO:scrape: 2022-07-10T14:22:04.315 INFO:scrape:Failure: 'check osd count' reached maximum tries (90) after waiting for 900 seconds 2022-07-10T14:22:04.315 INFO:scrape:4 jobs: ['6922214', '6922138', '6922344', '6922501'] 2022-07-10T14:22:04.316 INFO:scrape:suites intersection: ['0-kubeadm', '0-nvme-loop', '1-rook', '3-final', 'k8s/1.21', 'rados/rook/smoke/{0-distro/ubuntu_20.04'] 2022-07-10T14:22:04.316 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'net/flannel', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}'] 2022-07-10T14:22:04.317 INFO:scrape: 2022-07-10T14:22:04.317 INFO:scrape:Failure: Test failure: test_health_history (tasks.mgr.test_insights.TestInsights) 2022-07-10T14:22:04.318 INFO:scrape:1 jobs: ['6922204'] 2022-07-10T14:22:04.318 INFO:scrape:suites: ['debug/mgr', 'mgr_ttl_cache/disable', 'mon_election/connectivity', 'rados/mgr/{clusters/{2-node-mgr}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/insights}'] 2022-07-10T14:22:04.319 INFO:scrape: 2022-07-10T14:22:04.320 INFO:scrape:Failure: Command failed on smithi061 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:b30b05172da483d35b0dde3a1fd01d0a82676cd5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ee2fece-002c-11ed-842e-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *'" 2022-07-10T14:22:04.320 INFO:scrape:1 jobs: ['6922285'] 2022-07-10T14:22:04.320 INFO:scrape:suites: ['0-nvme-loop', 'agent/off', 'fixed-2', 'mon_election/connectivity', 'rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'start}'] 2022-07-10T14:22:04.321 INFO:scrape: 2022-07-10T14:22:04.321 INFO:scrape:Failure: {'smithi120.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi067.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-07-10T14:22:04.322 INFO:scrape:1 jobs: ['6922135'] 2022-07-10T14:22:04.322 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/careful', 'thrashosds-health', 'workloads/radosbench}'] 2022-07-10T14:22:04.323 INFO:scrape: 2022-07-10T14:22:04.323 INFO:scrape:Failure: {'smithi159.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi162.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-07-10T14:22:04.324 INFO:scrape:1 jobs: ['6922249'] 2022-07-10T14:22:04.324 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{default}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/write_fadvise_dontneed}'] 2022-07-10T14:22:04.325 INFO:scrape: 2022-07-10T14:22:04.334 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/ failed: 6 dead: 82 running: 0 waiting: 0 queued: 0 passed: 221 Fail ================================================================= [6922138] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:23:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922138/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922138/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef21e5984f214cdb91b57b8a58307939 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6922204] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{ubuntu_latest} tasks/insights} ----------------------------------------------------------------- time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922204/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922204/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a7b66956a3bf480aba5fd7f6c2d6c268 Test failure: test_health_history (tasks.mgr.test_insights.TestInsights) [6922214] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/flannel rook/1.7.2} ----------------------------------------------------------------- time: 00:31:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922214/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922214/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d96e6374b0704a5dacb58f9ff85ea18b 'check osd count' reached maximum tries (90) after waiting for 900 seconds [6922285] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922285/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922285/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a949d160c794adca9cae66f36ea49d6 Command failed on smithi061 with status 127: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:b30b05172da483d35b0dde3a1fd01d0a82676cd5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3ee2fece-002c-11ed-842e-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *'" [6922344] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922344/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922344/ sentry: https://sentry.ceph.com/organizations/ceph/?query=44b393192e844d10a9228027c3c1ceec 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6922501] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:21:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922501/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922501/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6e3121cd42154accbcc8ae9dccd52eb1 'wait for operator' reached maximum tries (90) after waiting for 900 seconds Dead ================================================================= [6922080] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922080/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922080/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bfd846b802694e81a0a4fa41ab4c3596 {'smithi109.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi172.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922082] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_python} ----------------------------------------------------------------- time: 00:07:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922082/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922082/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39b1cd16cb5945488dc2ffacc4d0df2b {'smithi132.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi008.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922083] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} ----------------------------------------------------------------- time: 00:07:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922083/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922083/ sentry: https://sentry.ceph.com/organizations/ceph/?query=10bb54c9266b4f5582702f9633c127ff {'smithi122.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi112.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922085] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:07:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922085/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922085/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91a9b0f8dd4043458c75e046a7c54505 {'smithi154.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi153.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922091] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922091/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922091/ sentry: https://sentry.ceph.com/organizations/ceph/?query=743d1f619ff3477cbca39cac0f3918dc {'smithi078.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi170.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922092] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922092/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922092/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ca67cd7cff84df393dffb623ab23935 {'smithi098.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922098] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922098/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922098/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8923d9dcdbd44819a4474846ca7da369 {'smithi136.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922100] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922100/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a43c720821e40f0b77918112ff8410e {'smithi150.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi081.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922102] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922102/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922102/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e1415e7381b0448db8d033553226315e {'smithi157.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi139.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi036.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922103] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:08:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922103/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922103/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a1c34d84a7e4ab0b9f264751409562b {'smithi066.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi031.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922109] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922109/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922109/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4c724b06dec94d9ead91c5678bf9025d {'smithi119.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi169.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922110] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} ----------------------------------------------------------------- time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922110/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922110/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f1a2b80582c479783356fc02e87c171 {'smithi165.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi032.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922117] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922117/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922117/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da3e76cfd0f649adb4623b5ffd9bf80f {'smithi100.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922121] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922121/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922121/ sentry: https://sentry.ceph.com/organizations/ceph/?query=467542d64b98474e99648e95ec94c9ba {'smithi123.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi098.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922122] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} ----------------------------------------------------------------- time: 00:07:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922122/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922122/ sentry: https://sentry.ceph.com/organizations/ceph/?query=306782a4885f45348172fd067771926e {'smithi161.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi008.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi007.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922127] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922127/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922127/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b32e8e9ed9d4c88b4abbdce14d988e6 {'smithi153.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi154.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922128] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922128/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922128/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c34f4fc68c04dedb36f254a6209a77b {'smithi078.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi170.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi112.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi061.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922135] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922135/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922135/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59e55faa9df3499bb0aa3303ba793f70 {'smithi120.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi067.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922150] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} ----------------------------------------------------------------- time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922150/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922150/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eddf4b8c8a4746b08229a18daea203b5 {'smithi134.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi202.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922159] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:07:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922159/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922159/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b48c940c76344d9ac2ffa7c905595fb {'smithi098.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi123.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi096.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922163] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:07:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922163/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922163/ sentry: https://sentry.ceph.com/organizations/ceph/?query=265616d76cba4c3ebdeab46ef7896e89 {'smithi181.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi037.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi159.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi043.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922165] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} ----------------------------------------------------------------- time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922165/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922165/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2d4f1712591e4ab48bc7820e8eb93c2a {'smithi078.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi170.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922171] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922171/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922171/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77fb39a2b03f4e7585f501346bc0ab56 {'smithi115.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922172] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/failover} ----------------------------------------------------------------- time: 00:06:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922172/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922172/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6050c7c126764eaa9d1a0defb603ec97 {'smithi035.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi033.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922175] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922175/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922175/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b1ed9fe0e4dc4f79b32afeb0994cbdbf {'smithi135.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi083.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922177] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922177/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922177/ sentry: https://sentry.ceph.com/organizations/ceph/?query=487e5955087043889a93d094746ed48d {'smithi111.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922189] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:09:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922189/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=56ebe03abfa04d4f8291bcfe93694132 {'smithi131.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi078.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi170.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi171.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922195] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:08:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922195/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922195/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1d931d9e52d541ccbdf9a54f73eb71fd {'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi038.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922196] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} ----------------------------------------------------------------- time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922196/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922196/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6353ac930c84432986b0dd1bd03d190d {'smithi167.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi163.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922199] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922199/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922199/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1ff0a7aeaef7424d8a93d494d872c80e {'smithi181.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922205] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922205/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922205/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed4f5d15b40f49939269839b3b793bbe {'smithi130.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi027.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922208] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:08:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922208/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922208/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39a3446b22eb44c2a9c02b08aa6bb2b8 {'smithi114.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi094.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922215] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922215/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922215/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82a6b486d6df491894d7ae396e16f500 {'smithi083.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922216] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:07:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922216/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922216/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c188353efaea4384b850dfd22f08c160 {'smithi129.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi158.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922221] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922221/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922221/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bb661423546f41a9b5b40b89ea18143e {'smithi150.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922229] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:48 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922229/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922229/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b7d46dc630a4a3396764baac49315ea {'smithi078.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922230] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:07:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922230/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cecf69e0ce1d4473b8fc46981792884e {'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi038.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922233] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922233/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922233/ sentry: https://sentry.ceph.com/organizations/ceph/?query=30a3c9bbef90463886a527b7f18334e0 {'smithi057.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922245] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922245/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922245/ sentry: https://sentry.ceph.com/organizations/ceph/?query=35fd82e7249c4c8882972da47ec147f2 {'smithi026.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922249] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922249/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922249/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1867d2845247408e8e685a5e6cb44308 {'smithi159.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi162.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922251] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922251/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922251/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2cc02e956eaa4a45a8c5027ae7788c23 {'smithi052.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922259] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922259/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9949013ca35c459e8acde66f6159ff56 {'smithi157.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi139.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi112.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi061.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922261] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922261/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922261/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c928d1fabb642428315ce211f6f3b3a {'smithi156.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922263] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/repair_test} ----------------------------------------------------------------- time: 00:07:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922263/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922263/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ff4efba0ed041acb141b1a6b64d6393 {'smithi078.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi060.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922265] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} ----------------------------------------------------------------- time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922265/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922265/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d8856d8e6344f3ab2597e42644e4e74 {'smithi089.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi204.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922267] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:06:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922267/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922267/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9456a63730cd4b2ab254b77fa742e3b6 {'smithi057.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922269] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922269/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=75e6eadd75784992ae6d27b4d9cd0c5a {'smithi120.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922275] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:07:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922275/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922275/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aae1cd1678834283a12f7758a2df3193 {'smithi077.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi086.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi032.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922279] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922279/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922279/ sentry: https://sentry.ceph.com/organizations/ceph/?query=afc51f384f8f4a4f8e0dbcb1f825eac7 {'smithi132.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922291] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} ----------------------------------------------------------------- time: 00:06:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922291/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922291/ sentry: https://sentry.ceph.com/organizations/ceph/?query=03a33b0770214f4e8417d7da328263b0 {'smithi153.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi154.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922301] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922301/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922301/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e6b8682697354a54bc7810b71ef37d3e {'smithi007.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922303] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/progress} ----------------------------------------------------------------- time: 00:07:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922303/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922303/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c146e667d06e4dc78da045bffbf02953 {'smithi137.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi125.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922313] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:09 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922313/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922313/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b237a20582e340b09914e9f7e8d3d1ed {'smithi165.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922318] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922318/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922318/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a6e9507f3064fe1b17e0f44dc01b8b7 {'smithi083.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi202.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi185.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi188.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922338] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:06:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922338/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922338/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a832c776051486bbc79716c3578dd24 {'smithi125.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi137.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922340] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_5925} ----------------------------------------------------------------- time: 00:06:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922340/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922340/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f71ba8651b1e406a8cb85d35bd9de8d1 {'smithi106.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi019.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922346] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922346/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922346/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b18b4cce49734c84bb835fdc9c7a7f5d {'smithi122.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922354] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:37 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922354/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922354/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a84f9e9a98044b7eb569b4ad34cae3ba {'smithi175.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922356] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} ----------------------------------------------------------------- time: 00:07:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922356/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922356/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bf43d025033c43bca108eeeeb21a539a {'smithi202.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi188.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922360] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922360/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922360/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca31b76daf5b4f549cd177add17e5117 {'smithi136.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922362] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922362/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922362/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5483b36c4b1e4224a0162b8e348f6c3f {'smithi164.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922364] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:07:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922364/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922364/ sentry: https://sentry.ceph.com/organizations/ceph/?query=557b66058aaf4e9dbf70be4b9abc9003 {'smithi162.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi159.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922374] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922374/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922374/ sentry: https://sentry.ceph.com/organizations/ceph/?query=799af37ab2c54c949154ce07b09359b9 {'smithi080.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922383] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922383/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922383/ sentry: https://sentry.ceph.com/organizations/ceph/?query=03458147eb654480932c01b7ab5ca279 {'smithi115.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922385] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922385/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922385/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d8694c1514f4439a81c4c7c50aa952f {'smithi187.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi196.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922387] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} ----------------------------------------------------------------- time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922387/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922387/ sentry: https://sentry.ceph.com/organizations/ceph/?query=909d460a97d74b3ca219b43cd2ba9180 {'smithi111.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi026.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922403] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922403/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922403/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e7f1ab01bb25402ea507b204ff2618e4 {'smithi050.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922421] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922421/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922421/ sentry: https://sentry.ceph.com/organizations/ceph/?query=71f4e32661ca40be824b1ac3c77203ec {'smithi157.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922423] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} ----------------------------------------------------------------- time: 00:06:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922423/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922423/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c55592caff4a4331be8ae7d2f1559677 {'smithi053.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922425] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922425/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922425/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa0306dfd3fa47319de18c3eadf51d59 {'smithi169.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi137.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922435] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/workunits} ----------------------------------------------------------------- time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922435/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922435/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0fb9d760dddd410badd17974fd60e9f0 {'smithi133.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi110.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922457] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922457/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922457/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a73b91f2b215443d938fe3373c188a9a {'smithi067.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi018.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922459] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922459/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922459/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2247c41e8f38488aa6bcb9678a69a940 {'smithi143.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi046.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922471] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922471/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922471/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa49d36030bc45c288df3d017c502c3d {'smithi158.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi152.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922475] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922475/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922475/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2afd39616ce149d68bc9fe04be76c40d {'smithi078.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922479] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:07:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922479/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922479/ sentry: https://sentry.ceph.com/organizations/ceph/?query=54dcc13ecfd74f8eb8bad34e7f835744 {'smithi136.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922493] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:06:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922493/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922493/ sentry: https://sentry.ceph.com/organizations/ceph/?query=864a991e55c34beabc79ee71d1da4ffb {'smithi112.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi061.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922505] rados/singleton/{all/radostool mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922505/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922505/ sentry: https://sentry.ceph.com/organizations/ceph/?query=75310d3b19cb4256bb8b964529034544 {'smithi136.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922509] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:06:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922509/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922509/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b946ff264884ade84f4c8b48758186b {'smithi158.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi152.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922510] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922510/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922510/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e088d1982e4461082cb706b1944e61d {'smithi050.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922513] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:06:13 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922513/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922513/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0960c6f44aea4fccb5c059b79504abed {'smithi097.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi201.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi073.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} [6922514] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:06:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922514/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922514/ sentry: https://sentry.ceph.com/organizations/ceph/?query=338026638aa84cd39b67dd244e8df837 {'smithi008.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}, 'smithi040.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} Pass ================================================================= [6922081] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922081/ [6922084] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922084/ [6922086] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922086/ [6922087] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 03:15:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922087/ [6922088] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:20:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922088/ [6922089] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:18:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922089/ [6922090] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} time: 00:52:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922090/ [6922093] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:16:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922093/ [6922094] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:19:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922094/ [6922095] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922095/ [6922096] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:37:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922096/ [6922097] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} time: 00:27:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922097/ [6922099] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:17:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922099/ [6922101] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922101/ [6922104] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922104/ [6922105] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:24:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922105/ [6922106] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/workunits} time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922106/ [6922107] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:34:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922107/ [6922108] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922108/ [6922111] rados/cephadm/workunits/{agent/off mon_election/classic task/test_nfs} time: 00:34:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922111/ [6922112] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922112/ [6922113] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:31:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922113/ [6922114] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:28:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922114/ [6922115] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922115/ [6922116] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922116/ [6922118] rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} time: 02:29:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922118/ [6922119] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} time: 00:21:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922119/ [6922120] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922120/ [6922123] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:19:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922123/ [6922124] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8}} time: 00:34:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922124/ [6922125] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:24:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922125/ [6922126] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922126/ [6922129] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922129/ [6922130] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} time: 00:20:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922130/ [6922131] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922131/ [6922132] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922132/ [6922133] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922133/ [6922134] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 01:24:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922134/ [6922136] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922136/ [6922137] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:18:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922137/ [6922139] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:33:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922139/ [6922140] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:43:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922140/ [6922141] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:41:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922141/ [6922142] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922142/ [6922143] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:22:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922143/ [6922144] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922144/ [6922145] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922145/ [6922146] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922146/ [6922147] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922147/ [6922148] rados/cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922148/ [6922149] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} time: 02:02:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922149/ [6922151] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/dashboard} time: 02:07:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922151/ [6922152] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:13:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922152/ [6922153] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922153/ [6922154] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922154/ [6922155] rados/standalone/{supported-random-distro$/{centos_8} workloads/c2c} time: 00:18:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922155/ [6922156] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:21:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922156/ [6922157] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:23:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922157/ [6922158] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:34:52 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922158/ [6922160] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:25:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922160/ [6922161] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} time: 00:26:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922161/ [6922162] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922162/ [6922164] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922164/ [6922166] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922166/ [6922167] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922167/ [6922168] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922168/ [6922169] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922169/ [6922170] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_workunits} time: 00:36:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922170/ [6922173] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922173/ [6922174] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922174/ [6922176] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922176/ [6922178] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:19:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922178/ [6922179] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922179/ [6922180] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} time: 00:19:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922180/ [6922181] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922181/ [6922182] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:44:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922182/ [6922183] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} time: 00:17:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922183/ [6922184] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:17:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922184/ [6922185] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:29:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922185/ [6922186] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922186/ [6922187] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922187/ [6922188] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:34:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922188/ [6922190] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922190/ [6922191] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:24:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922191/ [6922192] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922192/ [6922193] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:41:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922193/ [6922194] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922194/ [6922197] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:18:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922197/ [6922198] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922198/ [6922200] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922200/ [6922201] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:31:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922201/ [6922202] rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922202/ [6922203] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:34:04 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922203/ [6922206] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922206/ [6922207] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922207/ [6922209] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922209/ [6922210] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} time: 00:52:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922210/ [6922211] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922211/ [6922212] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922212/ [6922213] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:29:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922213/ [6922217] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:28:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922217/ [6922218] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:16:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922218/ [6922219] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922219/ [6922220] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:31:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922220/ [6922222] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} time: 00:33:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922222/ [6922223] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922223/ [6922224] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:29:42 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922224/ [6922225] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922225/ [6922226] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922226/ [6922227] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:34:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922227/ [6922228] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:38:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922228/ [6922231] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} time: 00:40:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922231/ [6922232] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zstd} tasks/e2e} time: 00:25:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922232/ [6922234] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:26:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922234/ [6922235] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922235/ [6922236] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:22:33 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922236/ [6922237] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922237/ [6922239] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:45:22 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922239/ [6922241] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:28:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922241/ [6922243] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:15:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922243/ [6922247] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:24:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922247/ [6922253] rados/cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} time: 00:21:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922253/ [6922255] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 01:11:11 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922255/ [6922257] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:13:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922257/ [6922271] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:23:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922271/ [6922273] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:09:36 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922273/ [6922277] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922277/ [6922281] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:18:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922281/ [6922283] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:22:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922283/ [6922287] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922287/ [6922289] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922289/ [6922293] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:55:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922293/ [6922295] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922295/ [6922297] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:27:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922297/ [6922299] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:41:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922299/ [6922305] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922305/ [6922307] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922307/ [6922309] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922309/ [6922311] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:31:56 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922311/ [6922315] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922315/ [6922317] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922317/ [6922321] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922321/ [6922323] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:33:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922323/ [6922325] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922325/ [6922327] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-radosbench} time: 01:36:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922327/ [6922328] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922328/ [6922330] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:20:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922330/ [6922332] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922332/ [6922334] rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm} time: 00:19:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922334/ [6922336] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922336/ [6922342] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922342/ [6922348] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 01:03:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922348/ [6922350] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:21:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922350/ [6922352] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:19:39 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922352/ [6922358] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:25:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922358/ [6922366] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:28:29 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922366/ [6922368] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922368/ [6922370] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:25:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922370/ [6922372] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:31:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922372/ [6922377] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922377/ [6922379] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922379/ [6922381] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/dashboard} time: 01:38:06 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922381/ [6922389] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:26:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922389/ [6922391] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:22:20 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922391/ [6922393] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:30:58 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922393/ [6922395] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922395/ [6922397] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922397/ [6922399] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922399/ [6922401] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922401/ [6922405] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:29:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922405/ [6922407] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922407/ [6922409] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_api_tests} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922409/ [6922411] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:13:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922411/ [6922413] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:44:31 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922413/ [6922415] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922415/ [6922417] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922417/ [6922419] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 02:08:08 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922419/ [6922427] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:23:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922427/ [6922429] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922429/ [6922431] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:00:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922431/ [6922433] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:38 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922433/ [6922437] rados/cephadm/workunits/{agent/on mon_election/classic task/test_nfs} time: 00:37:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922437/ [6922439] rados/singleton/{all/peer mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:32 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922439/ [6922441] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922441/ [6922443] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922443/ [6922445] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922445/ [6922447] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922447/ [6922449] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} time: 00:17:45 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922449/ [6922451] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:12 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922451/ [6922453] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922453/ [6922455] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:22:50 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922455/ [6922461] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922461/ [6922463] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922463/ [6922465] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:27:53 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922465/ [6922467] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:26:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922467/ [6922469] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922469/ [6922473] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922473/ [6922477] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_orch_cli} time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922477/ [6922481] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} time: 04:27:44 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922481/ [6922483] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922483/ [6922485] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:09:57 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922485/ [6922487] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:30:40 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922487/ [6922489] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922489/ [6922491] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:16:51 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922491/ [6922495] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:17:28 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922495/ [6922497] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:22:55 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922497/ [6922499] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/crash} time: 00:15:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922499/ [6922503] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922503/ [6922504] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:02 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922504/ [6922506] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922506/ [6922507] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:33:14 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922507/ [6922508] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:21 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922508/ [6922511] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922511/ [6922512] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{ubuntu_latest}} time: 02:22:01 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922512/ [6922515] rados/cephadm/workunits/{agent/off mon_election/classic task/test_adoption} time: 00:10:18 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922515/ [6922516] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench} time: 00:30:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922516/ [6922517] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:29:03 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922517/ [6922518] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:25 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922518/ [6922519] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922519/ [6922520] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} tasks/e2e} time: 00:23:47 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922520/ [6922521] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2022-07-10_07:01:07-rados-quincy-distro-default-smithi/6922521/