2022-07-14T01:40:55.519 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5 2022-07-14T01:40:55.521 INFO:teuthology.results:subset: '111/120000' 2022-07-14T01:40:55.522 INFO:teuthology.results:seed: '5869' 2022-07-14T03:50:31.436 INFO:root:teuthology version: 1.1.1.dev383+g89d874d5 2022-07-14T03:50:31.479 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-14T07:53:57.131 INFO:teuthology.results:Tests finished! gathering results... 2022-07-14T07:54:20.018 INFO:scrape:Found 262 jobs 2022-07-14T07:54:27.242 INFO:scrape:Found 5 distinct failure reasons 2022-07-14T07:54:27.243 INFO:scrape:Failure: Command failed on smithi146 with status 1: 'sudo yum -y install ceph-radosgw' 2022-07-14T07:54:27.244 INFO:scrape:63 jobs 2022-07-14T07:54:27.245 INFO:scrape:suites intersection: [] 2022-07-14T07:54:27.245 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/off', 'd-balancer/upmap', 'debug/mgr', 'fast/fast', 'fast/normal', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/dashboard/{clusters/{2-node-mgr}', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/21', 'rados/multimon/{clusters/3', 'rados/multimon/{clusters/9', 'rados/objectstore/{backends/alloc-hint', 'rados/objectstore/{backends/filestore-idempotent-aio-journal', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/export-after-evict', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/singleton-nomsgr/{all/pool-access', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/backfill-toofull', 'rados/singleton/{all/deduptool', 'rados/singleton/{all/dump-stuck', 'rados/singleton/{all/max-pg-per-osd.from-primary', 'rados/singleton/{all/osd-recovery-incomplete', 'rados/singleton/{all/pg-removal-interruption', 'rados/singleton/{all/random-eio', 'rados/singleton/{all/rebuild-mondb', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/singleton/{all/watch-notify-same-primary', 'rados/standalone/{supported-random-distro$/{rhel_8}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/dashboard}', 'tasks/insights}', 'tasks/mon_clock_no_skews}', 'tasks/mon_clock_with_skews}', 'tasks/progress}', 'tasks/prometheus}', 'tasks/rados_workunit_loadgen_mostlyread}', 'tasks/workunits}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/force-sync-many', 'thrashers/many', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/one', 'thrashers/pggrow', 'thrashers/sync', 'thrashosds-health', 'thrashosds-health}', 'workloads/admin_socket_objecter_requests}', 'workloads/cache-agent-big}', 'workloads/cache-snaps-balanced}', 'workloads/crush}', 'workloads/dedup_tier}', 'workloads/ec-rados-plugin=clay-k=4-m=2}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects-fast-read-overwrites}', 'workloads/ec-small-objects-many-deletes}', 'workloads/ec-small-objects}', 'workloads/erasure-code}', 'workloads/mon}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_mon_workunits}', 'workloads/radosbench}', 'workloads/set-chunk-promote-flush}', 'workloads/small-objects}', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects}', 'workloads/write_fadvise_dontneed}'] 2022-07-14T07:54:27.246 INFO:scrape: 2022-07-14T07:54:27.246 INFO:scrape:Failure: Test failure: test_pool_create_with_compression (tasks.mgr.dashboard.test_pool.PoolTest) 2022-07-14T07:54:27.247 INFO:scrape:1 jobs: ['6929167'] 2022-07-14T07:54:27.247 INFO:scrape:suites: ['debug/mgr', 'objectstore/bluestore-low-osd-mem-target', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_8}', 'tasks/dashboard}'] 2022-07-14T07:54:27.248 INFO:scrape: 2022-07-14T07:54:27.248 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi117.front.sepia.ceph.com: ['type=AVC msg=audit(1657771022.333:18262): avc: denied { ioctl } for pid=112326 comm="iptables" path="/var/lib/containers/storage/overlay/8b7839f5de4f2e930174fc782c019c5eb723a8fe2bbb27c0521f031559654091/merged" dev="overlay" ino=3541388 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-07-14T07:54:27.249 INFO:scrape:1 jobs: ['6929379'] 2022-07-14T07:54:27.249 INFO:scrape:suites: ['rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-07-14T07:54:27.250 INFO:scrape: 2022-07-14T07:54:27.250 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi139.front.sepia.ceph.com: ['type=AVC msg=audit(1657764051.903:16571): avc: denied { open } for pid=1007 comm="sssd_be" path="/etc/resolv.conf" dev="sda1" ino=262271 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1'] 2022-07-14T07:54:27.251 INFO:scrape:1 jobs: ['6929169'] 2022-07-14T07:54:27.252 INFO:scrape:suites: ['rados/objectstore/{backends/keyvaluedb', 'supported-random-distro$/{centos_8}}'] 2022-07-14T07:54:27.253 INFO:scrape: 2022-07-14T07:54:27.253 INFO:scrape:Failure: Test failure: test_health_history (tasks.mgr.test_insights.TestInsights) 2022-07-14T07:54:27.254 INFO:scrape:1 jobs: ['6929403'] 2022-07-14T07:54:27.254 INFO:scrape:suites: ['debug/mgr', 'objectstore/bluestore-comp-lz4', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_18.04}', 'tasks/insights}'] 2022-07-14T07:54:27.255 INFO:scrape: 2022-07-14T07:54:27.266 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/ failed: 67 dead: 0 running: 0 waiting: 0 queued: 0 passed: 195 Fail ================================================================= [6929134] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929134/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929134/ sentry: https://sentry.ceph.com/organizations/ceph/?query=927c1c6fa63f427a8e91d7fdd4cb3985 Command failed on smithi156 with status 1: 'sudo yum -y install ceph- radosgw' [6929144] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} ----------------------------------------------------------------- time: 00:09:44 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929144/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929144/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48951be5823f4d278eabac2d17b1cec1 Command failed on smithi140 with status 1: 'sudo yum -y install ceph- radosgw' [6929150] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} ----------------------------------------------------------------- time: 00:11:07 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929150/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929150/ sentry: https://sentry.ceph.com/organizations/ceph/?query=65a999cce19d46cfa463f9c7b6b3cf4f Command failed on smithi195 with status 1: 'sudo yum -y install ceph- radosgw' [6929153] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:14:55 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929153/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929153/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4b579c5512964b18acf6af4752921156 Command failed on smithi110 with status 1: 'sudo yum -y install ceph- radosgw' [6929156] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:12:46 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929156/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929156/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb977ee77206424cbdd277c780c8fc0e Command failed on smithi090 with status 1: 'sudo yum -y install ceph- radosgw' [6929167] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 01:05:20 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929167/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929167/ sentry: https://sentry.ceph.com/organizations/ceph/?query=23e0e8cf860640d1bd23c862e226c469 Test failure: test_pool_create_with_compression (tasks.mgr.dashboard.test_pool.PoolTest) [6929169] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:14:07 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929169/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929169/ SELinux denials found on ubuntu@smithi139.front.sepia.ceph.com: ['type=AVC msg=audit(1657764051.903:16571): avc: denied { open } for pid=1007 comm="sssd_be" path="/etc/resolv.conf" dev="sda1" ino=262271 scontext=system_u:system_r:sssd_t:s0 tcontext=unconfined_u:object_r:user_home_t:s0 tclass=file permissive=1'] [6929170] rados/singleton-bluestore/{all/cephtool msgr-failures/none msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929170/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929170/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e125208f3404cef9617f0522c900406 Command failed on smithi197 with status 1: 'sudo yum -y install ceph- radosgw' [6929173] rados/singleton/{all/watch-notify-same-primary msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:11:32 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929173/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929173/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f28b4e76966a4074be9f121592cf076c Command failed on smithi043 with status 1: 'sudo yum -y install ceph- radosgw' [6929180] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:13:44 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929180/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929180/ sentry: https://sentry.ceph.com/organizations/ceph/?query=214e78e578ab4ce6a8ac0d1281fb6639 Command failed on smithi063 with status 1: 'sudo yum -y install ceph- radosgw' [6929183] rados/multimon/{clusters/3 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} ----------------------------------------------------------------- time: 00:12:55 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929183/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929183/ sentry: https://sentry.ceph.com/organizations/ceph/?query=98c1f8875fc84b6d8f90a8bdc68043ca Command failed on smithi163 with status 1: 'sudo yum -y install ceph- radosgw' [6929186] rados/singleton/{all/backfill-toofull msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:11:12 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929186/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929186/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc5546438ef94194968f58f8ae199516 Command failed on smithi084 with status 1: 'sudo yum -y install ceph- radosgw' [6929189] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:08:31 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929189/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da224a786ad34ea69fa1aa89e65e0144 Command failed on smithi099 with status 1: 'sudo yum -y install ceph- radosgw' [6929190] rados/singleton/{all/deduptool msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:13 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929190/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929190/ sentry: https://sentry.ceph.com/organizations/ceph/?query=31f7dc492fe4430ea8e2b9b1e945e750 Command failed on smithi197 with status 1: 'sudo yum -y install ceph- radosgw' [6929194] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} ----------------------------------------------------------------- time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929194/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929194/ sentry: https://sentry.ceph.com/organizations/ceph/?query=54f2ff0be76e44418d548106021fe28b Command failed on smithi158 with status 1: 'sudo yum -y install ceph- radosgw' [6929204] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:09:01 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929204/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929204/ sentry: https://sentry.ceph.com/organizations/ceph/?query=51be437b5e5d4789937fc8d7f3bf958d Command failed on smithi201 with status 1: 'sudo yum -y install ceph- radosgw' [6929208] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:09:17 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929208/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929208/ sentry: https://sentry.ceph.com/organizations/ceph/?query=501e9f15880f4e678f5b1b4850613e89 Command failed on smithi162 with status 1: 'sudo yum -y install ceph- radosgw' [6929210] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929210/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f4767b145f047758cfebd69a9b62841 Command failed on smithi159 with status 1: 'sudo yum -y install ceph- radosgw' [6929213] rados/singleton/{all/dump-stuck msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:53 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929213/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929213/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d86b7693a08e4157b5d1fff42ee5f81a Command failed on smithi176 with status 1: 'sudo yum -y install ceph- radosgw' [6929215] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} ----------------------------------------------------------------- time: 00:09:22 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929215/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929215/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e42f2d718756453aa8d4d24ba61b030c Command failed on smithi073 with status 1: 'sudo yum -y install ceph- radosgw' [6929216] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/insights} ----------------------------------------------------------------- time: 00:09:30 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929216/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929216/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5e3df690d16a4de899e78188b3a2d964 Command failed on smithi072 with status 1: 'sudo yum -y install ceph- radosgw' [6929220] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/dedup_tier} ----------------------------------------------------------------- time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929220/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929220/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bab8b966c3ba453587b68352854bd2be Command failed on smithi088 with status 1: 'sudo yum -y install ceph- radosgw' [6929221] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:10:07 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929221/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929221/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a9246c5120344412b7f1d0637f1264aa Command failed on smithi099 with status 1: 'sudo yum -y install ceph- radosgw' [6929229] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 00:09:37 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929229/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929229/ sentry: https://sentry.ceph.com/organizations/ceph/?query=27be8d2cc8a34ffab08b80c8c0d78392 Command failed on smithi125 with status 1: 'sudo yum -y install ceph- radosgw' [6929232] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:10:38 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929232/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929232/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eb87e3650597426690e789de3f63fbd9 Command failed on smithi195 with status 1: 'sudo yum -y install ceph- radosgw' [6929236] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:11:27 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929236/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929236/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ca21639bef2479f92a69e18535190c6 Command failed on smithi146 with status 1: 'sudo yum -y install ceph- radosgw' [6929240] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:14 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929240/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929240/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b1201adc43d4b6ea2944b2895cf9780 Command failed on smithi201 with status 1: 'sudo yum -y install ceph- radosgw' [6929243] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} ----------------------------------------------------------------- time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929243/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929243/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc419fec8e1a4c85908502c9684afdbb Command failed on smithi049 with status 1: 'sudo yum -y install ceph- radosgw' [6929247] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:10:38 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929247/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929247/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a089f4dcd2b4c739a0a64c32390dd45 Command failed on smithi159 with status 1: 'sudo yum -y install ceph- radosgw' [6929249] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929249/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929249/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5fffc7552d87481cbb7286d188ca7cee Command failed on smithi012 with status 1: 'sudo yum -y install ceph- radosgw' [6929252] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:06 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929252/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929252/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7ec43e9f2e11499ea66b1537804ff05c Command failed on smithi116 with status 1: 'sudo yum -y install ceph- radosgw' [6929254] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:08 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929254/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929254/ sentry: https://sentry.ceph.com/organizations/ceph/?query=450e227686f84c20a985ee12f03237bb Command failed on smithi161 with status 1: 'sudo yum -y install ceph- radosgw' [6929255] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} ----------------------------------------------------------------- time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929255/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929255/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb32687efd0641b4846d361922af5a5d Command failed on smithi061 with status 1: 'sudo yum -y install ceph- radosgw' [6929258] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:09:22 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929258/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929258/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c281f2c72e1e4688afa1e1bd68bcea8d Command failed on smithi088 with status 1: 'sudo yum -y install ceph- radosgw' [6929269] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/progress} ----------------------------------------------------------------- time: 00:09:42 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929269/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0c17b7975cec4b8f8860a152e8804a3d Command failed on smithi131 with status 1: 'sudo yum -y install ceph- radosgw' [6929278] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:10:02 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929278/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929278/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c955ab330f5a44d3923cccdb477cc651 Command failed on smithi078 with status 1: 'sudo yum -y install ceph- radosgw' [6929280] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:10:05 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929280/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929280/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ce942ab4fd94102bdc0235105db4085 Command failed on smithi146 with status 1: 'sudo yum -y install ceph- radosgw' [6929291] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:15 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929291/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929291/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da46671dcc344124bc4732b487b26922 Command failed on smithi119 with status 1: 'sudo yum -y install ceph- radosgw' [6929295] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/prometheus} ----------------------------------------------------------------- time: 00:09:56 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929295/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929295/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79f88b85f76947438806fe75bce9fc8a Command failed on smithi102 with status 1: 'sudo yum -y install ceph- radosgw' [6929296] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} ----------------------------------------------------------------- time: 00:09:19 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929296/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929296/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59946bc0c22d439a9bfb57baf34474a5 Command failed on smithi017 with status 1: 'sudo yum -y install ceph- radosgw' [6929297] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/set-chunk-promote-flush} ----------------------------------------------------------------- time: 00:09:49 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929297/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929297/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e7a07f8f5a2c4870acad224c6bb24fee Command failed on smithi179 with status 1: 'sudo yum -y install ceph- radosgw' [6929302] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:27 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929302/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929302/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fea6a7231efa45019c0b23ad67dbd6d5 Command failed on smithi052 with status 1: 'sudo yum -y install ceph- radosgw' [6929304] rados/singleton/{all/osd-recovery-incomplete msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929304/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929304/ sentry: https://sentry.ceph.com/organizations/ceph/?query=17d7000aa2f04a81a6d0bd7abeefc749 Command failed on smithi001 with status 1: 'sudo yum -y install ceph- radosgw' [6929316] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:10:31 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929316/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929316/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58bacffebae24229806bd6bf0b8016f8 Command failed on smithi185 with status 1: 'sudo yum -y install ceph- radosgw' [6929319] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:28 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929319/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929319/ sentry: https://sentry.ceph.com/organizations/ceph/?query=684d1b9c44474762ab9847e16ee9041e Command failed on smithi117 with status 1: 'sudo yum -y install ceph- radosgw' [6929321] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/workunits} ----------------------------------------------------------------- time: 00:10:17 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929321/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929321/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bba1e478ab7840e3bf0f1f058fcb6755 Command failed on smithi130 with status 1: 'sudo yum -y install ceph- radosgw' [6929327] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} ----------------------------------------------------------------- time: 00:09:58 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929327/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929327/ sentry: https://sentry.ceph.com/organizations/ceph/?query=55f78ecf03a1422f9b88725656e86ed6 Command failed on smithi162 with status 1: 'sudo yum -y install ceph- radosgw' [6929328] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} ----------------------------------------------------------------- time: 00:09:44 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929328/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929328/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dcd1dc1fbe174b9394e4c9ff411864e0 Command failed on smithi104 with status 1: 'sudo yum -y install ceph- radosgw' [6929332] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:19 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929332/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929332/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4792fbef643a4adeb286cf6ab8a2c6fb Command failed on smithi053 with status 1: 'sudo yum -y install ceph- radosgw' [6929338] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} ----------------------------------------------------------------- time: 00:09:15 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929338/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929338/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5865c1ca3af748a6b67825ed823d97f6 Command failed on smithi072 with status 1: 'sudo yum -y install ceph- radosgw' [6929339] rados/singleton/{all/pg-removal-interruption msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:03 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929339/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929339/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3cb7b9e796dc42ef8486177b31853c53 Command failed on smithi001 with status 1: 'sudo yum -y install ceph- radosgw' [6929340] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:10:17 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929340/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929340/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0249e9bda834e689b6327dade8dd939 Command failed on smithi171 with status 1: 'sudo yum -y install ceph- radosgw' [6929344] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929344/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929344/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cba66c6ef60f44b5a14241b0cb31a284 Command failed on smithi117 with status 1: 'sudo yum -y install ceph- radosgw' [6929345] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929345/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929345/ sentry: https://sentry.ceph.com/organizations/ceph/?query=edb84097c89f4d719b58b68f27e4fe9a Command failed on smithi172 with status 1: 'sudo yum -y install ceph- radosgw' [6929355] rados/singleton/{all/random-eio msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:55 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929355/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929355/ sentry: https://sentry.ceph.com/organizations/ceph/?query=83c6a106957d466da36506dbb167355e Command failed on smithi078 with status 1: 'sudo yum -y install ceph- radosgw' [6929357] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:09:48 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929357/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929357/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ae997004cc14c59984b4c545c2707c0 Command failed on smithi104 with status 1: 'sudo yum -y install ceph- radosgw' [6929358] rados/singleton/{all/rebuild-mondb msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:13 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929358/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929358/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79ea3fc775b540c3af1d61edc8302cd5 Command failed on smithi159 with status 1: 'sudo yum -y install ceph- radosgw' [6929363] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:09:59 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929363/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929363/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d0e6403f23348828cfa5592d899aa0a Command failed on smithi181 with status 1: 'sudo yum -y install ceph- radosgw' [6929367] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:09:56 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929367/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929367/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6a7d404b8b644904b632696f7fe3d636 Command failed on smithi135 with status 1: 'sudo yum -y install ceph- radosgw' [6929371] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:09:52 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929371/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929371/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24374e29ce0d476b99913031c7aae4da Command failed on smithi129 with status 1: 'sudo yum -y install ceph- radosgw' [6929377] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} ----------------------------------------------------------------- time: 00:09:52 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929377/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929377/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9be58b6eb1684c6ba34cc623b4c594e2 Command failed on smithi183 with status 1: 'sudo yum -y install ceph- radosgw' [6929378] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:10:31 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929378/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929378/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e52496e245c488199301fecd54466de Command failed on smithi073 with status 1: 'sudo yum -y install ceph- radosgw' [6929379] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools task/test_cephadm} ----------------------------------------------------------------- time: 00:15:59 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929379/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929379/ SELinux denials found on ubuntu@smithi117.front.sepia.ceph.com: ['type=AVC msg=audit(1657771022.333:18262): avc: denied { ioctl } for pid=112326 comm="iptables" path="/var/lib/containers/storage/overlay/8b7839f5de4f2e930 174fc782c019c5eb723a8fe2bbb27c0521f031559654091/merged" dev="overlay" ino=3541388 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6929380] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929380/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929380/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6a615e3004cb450e9727c34fec7b3558 Command failed on smithi172 with status 1: 'sudo yum -y install ceph- radosgw' [6929382] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-big} ----------------------------------------------------------------- time: 00:09:32 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929382/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929382/ sentry: https://sentry.ceph.com/organizations/ceph/?query=587ce6f97a01444c9c9e34c8c833110b Command failed on smithi099 with status 1: 'sudo yum -y install ceph- radosgw' [6929397] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:09:35 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929397/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929397/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e99c3fef1e6542d98dcb3b23f6afab80 Command failed on smithi079 with status 1: 'sudo yum -y install ceph- radosgw' [6929403] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_18.04} tasks/insights} ----------------------------------------------------------------- time: 00:20:37 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929403/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929403/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a1b8dd14aba41c38b215e50404c00f1 Test failure: test_health_history (tasks.mgr.test_insights.TestInsights) Pass ================================================================= [6929135] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} tasks/repair_test} time: 00:20:57 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929135/ [6929136] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:13 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929136/ [6929137] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04}} time: 00:18:46 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929137/ [6929138] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:29:35 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929138/ [6929139] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:57:39 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929139/ [6929140] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_18.04}} time: 00:11:33 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929140/ [6929141] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:22:17 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929141/ [6929142] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:39:17 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929142/ [6929143] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/workunits} time: 00:16:18 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929143/ [6929145] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:39:06 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929145/ [6929146] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929146/ [6929147] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04 start} time: 00:22:51 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929147/ [6929148] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_8}} time: 00:15:04 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929148/ [6929149] rados/singleton/{all/thrash-eio msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04}} time: 00:42:21 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929149/ [6929151] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:46:48 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929151/ [6929152] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:59:05 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929152/ [6929154] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} time: 00:20:55 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929154/ [6929155] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:18:02 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929155/ [6929157] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:40 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929157/ [6929158] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:31:05 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929158/ [6929159] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:05 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929159/ [6929160] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:13:33 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929160/ [6929161] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} time: 00:25:02 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929161/ [6929162] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{centos_8}} time: 00:20:11 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929162/ [6929163] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:31:50 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929163/ [6929164] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:29:04 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929164/ [6929165] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:29:30 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929165/ [6929166] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:17:23 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929166/ [6929168] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/crash} time: 00:20:00 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929168/ [6929171] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:25:13 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929171/ [6929172] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:21:00 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929172/ [6929174] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:32:55 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929174/ [6929175] rados/singleton/{all/admin-socket msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04}} time: 00:12:10 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929175/ [6929176] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:32:01 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929176/ [6929177] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} time: 00:38:26 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929177/ [6929178] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_8}} time: 00:29:31 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929178/ [6929179] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:12:12 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929179/ [6929181] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:29:33 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929181/ [6929182] rados/standalone/{supported-random-distro$/{ubuntu_18.04} workloads/osd} time: 03:04:24 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929182/ [6929184] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} time: 00:47:45 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929184/ [6929185] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:49 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929185/ [6929187] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:27:42 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929187/ [6929188] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:10 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929188/ [6929191] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_18.04} tasks/failover} time: 00:16:31 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929191/ [6929192] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools task/test_cephadm_repos} time: 00:09:00 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929192/ [6929193] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{centos_8}} time: 00:21:20 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929193/ [6929195] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929195/ [6929196] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:34 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929196/ [6929197] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 02:01:24 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929197/ [6929198] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:26:46 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929198/ [6929199] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04}} time: 00:10:22 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929199/ [6929200] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929200/ [6929201] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:28:56 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929201/ [6929202] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:22:49 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929202/ [6929203] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:14:14 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929203/ [6929205] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:42:25 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929205/ [6929206] rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:16:50 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929206/ [6929207] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:20:47 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929207/ [6929209] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} time: 00:18:15 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929209/ [6929211] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:04 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929211/ [6929212] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:19 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929212/ [6929214] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:20:15 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929214/ [6929217] rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} time: 01:26:56 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929217/ [6929218] rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04}} time: 00:31:06 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929218/ [6929219] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04} tasks/rados_python} time: 00:15:40 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929219/ [6929222] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged msgr/async start tasks/rados_python} time: 00:27:18 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929222/ [6929223] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{ubuntu_latest}} time: 00:30:46 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929223/ [6929224] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 02:00:37 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929224/ [6929225] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 04:22:32 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929225/ [6929226] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:30:25 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929226/ [6929227] rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04}} time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929227/ [6929228] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:09:43 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929228/ [6929230] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} thrashers/many workloads/pool-create-delete} time: 00:21:54 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929230/ [6929231] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:26:28 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929231/ [6929233] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:32:07 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929233/ [6929234] rados/singleton/{all/lost-unfound-delete msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04}} time: 00:32:43 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929234/ [6929235] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:15 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929235/ [6929237] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:35 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929237/ [6929238] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:25:13 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929238/ [6929239] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools task/test_orch_cli} time: 00:22:57 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929239/ [6929241] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04}} time: 00:33:23 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929241/ [6929242] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:22:05 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929242/ [6929244] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_18.04} tasks/module_selftest} time: 00:53:24 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929244/ [6929245] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:43 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929245/ [6929246] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:31 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929246/ [6929248] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:26:36 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929248/ [6929250] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:24:20 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929250/ [6929251] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 02:06:24 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929251/ [6929253] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929253/ [6929256] rados/upgrade/mimic-x-singleton/{0-cluster/{openstack start} 1-install/mimic 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_18.04} time: 05:10:34 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929256/ [6929257] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:21:52 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929257/ [6929259] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_5925} time: 00:13:34 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929259/ [6929260] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:31:27 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929260/ [6929261] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} tasks/mon_clock_with_skews} time: 00:10:42 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929261/ [6929262] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:25:44 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929262/ [6929263] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_18.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:56 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929263/ [6929264] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:24:41 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929264/ [6929265] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:11 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929265/ [6929266] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929266/ [6929267] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04} tasks/rados_striper} time: 00:11:14 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929267/ [6929268] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929268/ [6929270] rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04}} time: 00:10:37 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929270/ [6929271] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:28 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929271/ [6929272] rados/cephadm/smoke/{distro/centos_8.stream_container_tools fixed-2 start} time: 00:16:46 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929272/ [6929273] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{ubuntu_latest}} time: 00:10:49 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929273/ [6929274] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:16:46 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929274/ [6929275] rados/singleton/{all/mon-config-key-caps msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04}} time: 00:11:07 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929275/ [6929276] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:17:21 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929276/ [6929277] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:01 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929277/ [6929279] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929279/ [6929281] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04} thrashers/sync-many workloads/rados_api_tests} time: 00:25:32 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929281/ [6929282] rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:11:54 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929282/ [6929283] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_18.04}} time: 00:14:47 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929283/ [6929284] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:30:45 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929284/ [6929285] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:17:58 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929285/ [6929286] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:19 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929286/ [6929287] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:05:35 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929287/ [6929288] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:43:55 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929288/ [6929289] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:34:49 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929289/ [6929290] rados/cephadm/smoke-roleless/{distro/centos_8.stream_container_tools start} time: 00:15:05 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929290/ [6929292] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:20 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929292/ [6929293] rados/singleton/{all/mon-config msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:13:18 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929293/ [6929294] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:37 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929294/ [6929298] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:53 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929298/ [6929299] rados/singleton/{all/osd-backfill msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:22:54 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929299/ [6929300] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:51 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929300/ [6929301] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} time: 00:18:45 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929301/ [6929303] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:20:38 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929303/ [6929305] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04} tasks/rados_workunit_loadgen_mix} time: 00:22:53 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929305/ [6929306] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:29 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929306/ [6929307] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:02 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929307/ [6929308] rados/multimon/{clusters/6 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04} tasks/mon_clock_no_skews} time: 00:10:01 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929308/ [6929309] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:19:19 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929309/ [6929310] rados/singleton/{all/osd-recovery msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04}} time: 00:15:16 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929310/ [6929311] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:27:40 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929311/ [6929312] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:41:53 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929312/ [6929313] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:28:38 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929313/ [6929314] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:25:32 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929314/ [6929315] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:19 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929315/ [6929317] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929317/ [6929318] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:36:12 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929318/ [6929320] rados/singleton/{all/peer msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:12:48 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929320/ [6929322] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:24:45 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929322/ [6929323] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 02:10:34 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929323/ [6929324] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:58 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929324/ [6929325] rados/singleton/{all/pg-autoscaler-progress-off msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04}} time: 00:12:36 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929325/ [6929326] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:16:09 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929326/ [6929329] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:11:46 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929329/ [6929330] rados/singleton/{all/pg-autoscaler msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:11:26 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929330/ [6929331] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools task/test_adoption} time: 00:12:24 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929331/ [6929333] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:24 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929333/ [6929334] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:09:09 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929334/ [6929335] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:29:42 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929335/ [6929336] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:42:03 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929336/ [6929337] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:27:52 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929337/ [6929341] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:31 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929341/ [6929342] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_18.04} tasks/dashboard} time: 01:58:34 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929342/ [6929343] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_18.04} tasks/crash} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929343/ [6929346] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:21:39 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929346/ [6929347] rados/singleton/{all/radostool msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:12:58 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929347/ [6929348] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:21:53 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929348/ [6929349] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:31:31 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929349/ [6929350] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} time: 00:22:10 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929350/ [6929351] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{ubuntu_18.04}} time: 00:09:34 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929351/ [6929352] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:34:33 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929352/ [6929353] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:13:56 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929353/ [6929354] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:27 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929354/ [6929356] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:00 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929356/ [6929359] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:27 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929359/ [6929360] rados/multimon/{clusters/21 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:29:57 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929360/ [6929361] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:27:52 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929361/ [6929362] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:25:36 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929362/ [6929364] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:25:32 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929364/ [6929365] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_18.04}} time: 00:10:59 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929365/ [6929366] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:39 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929366/ [6929368] rados/singleton/{all/recovery-preemption msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:24:39 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929368/ [6929369] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_18.04} tasks/failover} time: 00:19:05 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929369/ [6929370] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:27:40 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929370/ [6929372] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_18.04}} time: 02:26:17 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929372/ [6929373] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04} tasks/repair_test} time: 00:18:42 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929373/ [6929374] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:55 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929374/ [6929375] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929375/ [6929376] rados/singleton/{all/resolve_stuck_peering msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:27 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929376/ [6929381] rados/singleton/{all/test-crash msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04}} time: 00:10:25 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929381/ [6929383] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:24 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929383/ [6929384] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_18.04} time: 03:24:05 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929384/ [6929385] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:17 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929385/ [6929387] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:15:47 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929387/ [6929389] rados/multimon/{clusters/3 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:12:09 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929389/ [6929391] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 01:09:51 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929391/ [6929393] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:09:23 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929393/ [6929395] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:35:40 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929395/ [6929399] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:30 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929399/ [6929401] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:22:43 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929401/ [6929405] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2022-07-13_19:36:05-rados-octopus-release-distro-default-smithi/6929405/