2022-01-20T21:00:25.145 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-20T21:00:25.149 INFO:teuthology.results:subset: '111/120000'
2022-01-20T21:00:25.149 INFO:teuthology.results:seed: '8867'
2022-01-20T23:05:45.996 INFO:root:teuthology version: 1.1.0-75f1bcd2
2022-01-20T23:05:46.075 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-01-21T03:51:11.856 INFO:teuthology.results:Tests finished! gathering results...
2022-01-21T03:51:41.468 INFO:scrape:Found 262 jobs
2022-01-21T03:51:45.096 INFO:scrape:Found 6 distinct failure reasons
2022-01-21T03:51:45.097 INFO:scrape:Failure: SSH connection to smithi133 was lost: 'uname -r'
2022-01-21T03:51:45.098 INFO:scrape:5 jobs: ['6629956', '6630078', '6630110', '6630084', '6629985']
2022-01-21T03:51:45.098 INFO:scrape:suites intersection: ['rados']
2022-01-21T03:51:45.099 INFO:scrape:suites union: ['1-install/jewel', '1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'd-balancer/off', 'distro$/{ubuntu_18.04}', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/singleton/{all/backfill-toofull', 'rados/singleton/{all/mon-config-keys', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_18.04}', 'supported-random-distro$/{ubuntu_18.04}}', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/rbd_cls}', 'workloads/redirect_set_object}']
2022-01-21T03:51:45.099 INFO:scrape:
2022-01-21T03:51:45.100 INFO:scrape:Failure: Command failed on smithi052 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 30de3ae2-7a43-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi052:vg_nvme/lv_4'
2022-01-21T03:51:45.100 INFO:scrape:9 jobs: ['6630135', '6630059', '6630030', '6630189', '6630086', '6630161', '6629951', '6629980', '6630004']
2022-01-21T03:51:45.101 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{ubuntu_18.04}', 'rados', 'thrashosds-health', 'three-plus-one}']
2022-01-21T03:51:45.101 INFO:scrape:suites union: ['1-install/jewel-v1only', '1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/off', 'distro$/{ubuntu_18.04}', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}']
2022-01-21T03:51:45.102 INFO:scrape:
2022-01-21T03:51:45.102 INFO:scrape:Failure: Command failed on smithi017 with status 5: 'sudo systemctl stop ceph-c9387298-7a3a-11ec-8c35-001a4aab830c@mon.a'
2022-01-21T03:51:45.103 INFO:scrape:2 jobs: ['6630008', '6630100']
2022-01-21T03:51:45.103 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2}', 'rados/cephadm/upgrade/{1-start-distro/1-start-centos_8']
2022-01-21T03:51:45.104 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'fixed-2}', 'rados/cephadm/upgrade/{1-start-distro/1-start-centos_8']
2022-01-21T03:51:45.104 INFO:scrape:
2022-01-21T03:51:45.104 INFO:scrape:Failure: "2022-01-20T23:36:37.091383+0000 mon.a (mon.0) 356 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN)" in cluster log
2022-01-21T03:51:45.105 INFO:scrape:2 jobs: ['6630190', '6629950']
2022-01-21T03:51:45.105 INFO:scrape:suites intersection: ['msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}']
2022-01-21T03:51:45.106 INFO:scrape:suites union: ['clusters/3-mons', 'clusters/9-mons', 'msgr-failures/few', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}', 'thrashers/one', 'thrashers/sync-many', 'workloads/rados_mon_osdmap_prune}', 'workloads/snaps-few-objects}']
2022-01-21T03:51:45.106 INFO:scrape:
2022-01-21T03:51:45.107 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json
2022-01-21T03:51:45.107 INFO:scrape:1 jobs: ['6630157']
2022-01-21T03:51:45.108 INFO:scrape:suites: ['msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton/{all/rebuild-mondb', 'supported-random-distro$/{ubuntu_18.04}}']
2022-01-21T03:51:45.108 INFO:scrape:
2022-01-21T03:51:45.108 INFO:scrape:Crash: Command failed (workunit test rados/test_crash.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e98897febf3caebc1072d3529f386b5f75564b2f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_crash.sh'
2022-01-21T03:51:45.109 INFO:scrape:ceph version 15.2.15-160-ge98897fe (e98897febf3caebc1072d3529f386b5f75564b2f) octopus (stable)
 1: (()+0x12980) [0x7fec01846980]
 2: (pthread_cond_wait()+0x243) [0x7fec01841ad3]
 3: (std::condition_variable::wait(std::unique_lock<std::mutex>&)+0xc) [0x7fec00f188bc]
 4: (AsyncMessenger::wait()+0x8f) [0x55cc0c335f6f]
 5: (main()+0x4050) [0x55cc0bada1e0]
 6: (__libc_start_main()+0xe7) [0x7fec004dbbf7]
 7: (_start()+0x2a) [0x55cc0baef03a]
2022-01-21T03:51:45.109 INFO:scrape:1 jobs: ['6630180']
2022-01-21T03:51:45.110 INFO:scrape:suites: ['msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/test-crash', 'supported-random-distro$/{ubuntu_18.04}}']
2022-01-21T03:51:45.110 INFO:scrape:
2022-01-21T03:51:45.120 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/
failed:  15
dead:    5
running: 0
waiting: 0
queued:  0
passed:  242


Fail
=================================================================
[6629950]  rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_osdmap_prune}
-----------------------------------------------------------------
time:   00:41:48
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629950/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629950/

    "2022-01-20T21:37:18.644877+0000 mon.a (mon.0) 1426 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log

[6629951]  rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:09:05
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629951/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629951/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c4395865b3aa46f9a0268888f36ad858

    Command failed on smithi006 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    0dbc0f32-7a37-11ec-8c35-001a4aab830c -- ceph orch daemon add osd
    smithi006:vg_nvme/lv_4'

[6629980]  rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:08:45
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629980/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629980/
sentry: https://sentry.ceph.com/organizations/ceph/?query=edd69520e0ed4841ac230a327843a3bc

    Command failed on smithi102 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    1c678c94-7a39-11ec-8c35-001a4aab830c -- ceph orch daemon add osd
    smithi102:vg_nvme/lv_4'

[6630004]  rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:09:10
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630004/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630004/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f8568e59e41c4a5fbe78373d77c85720

    Command failed on smithi037 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    51cbcc0a-7a3a-11ec-8c35-001a4aab830c -- ceph orch daemon add osd
    smithi037:vg_nvme/lv_4'

[6630008]  rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2}
-----------------------------------------------------------------
time:   00:05:51
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630008/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630008/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d9eb20d5945f4733b10031972e39eb7d

    Command failed on smithi017 with status 5: 'sudo systemctl stop
    ceph-c9387298-7a3a-11ec-8c35-001a4aab830c@mon.a'

[6630030]  rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:09:08
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630030/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630030/
sentry: https://sentry.ceph.com/organizations/ceph/?query=44360fa8de554eafb4bb8648cedb55a9

    Command failed on smithi119 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    e002f078-7a3c-11ec-8c35-001a4aab830c -- ceph orch daemon add osd
    smithi119:vg_nvme/lv_4'

[6630059]  rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:09:06
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630059/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630059/
sentry: https://sentry.ceph.com/organizations/ceph/?query=37487593ef4c45cca1afdc838e2dce2d

    Command failed on smithi031 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    849d0f0a-7a3e-11ec-8c35-001a4aab830c -- ceph orch daemon add osd
    smithi031:vg_nvme/lv_4'

[6630086]  rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:08:44
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630086/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630086/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ab84ea9a35a748e0836d5d32d2eedf6c

    Command failed on smithi052 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    859b7868-7a40-11ec-8c35-001a4aab830c -- ceph orch daemon add osd
    smithi052:vg_nvme/lv_4'

[6630100]  rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2}
-----------------------------------------------------------------
time:   00:05:51
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630100/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630100/
sentry: https://sentry.ceph.com/organizations/ceph/?query=720a2bd424004c60aedc1cda4c5cf0da

    Command failed on smithi031 with status 5: 'sudo systemctl stop
    ceph-39c73778-7a41-11ec-8c35-001a4aab830c@mon.a'

[6630135]  rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:08:51
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630135/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630135/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cf2342ffcbd74788bd88cef395c32b0b

    Command failed on smithi052 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    30de3ae2-7a43-11ec-8c35-001a4aab830c -- ceph orch daemon add osd
    smithi052:vg_nvme/lv_4'

[6630157]  rados/singleton/{all/rebuild-mondb msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04}}
-----------------------------------------------------------------
time:   00:14:26
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630157/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630157/

    Command failed on smithi107 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph pg dump --format=json'

[6630161]  rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:08:54
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630161/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630161/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e5bb600a1c1c4bd3a1062eb71fe6d100

    Command failed on smithi138 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    bb94162e-7a44-11ec-8c35-001a4aab830c -- ceph orch daemon add osd
    smithi138:vg_nvme/lv_4'

[6630180]  rados/singleton/{all/test-crash msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04}}
-----------------------------------------------------------------
time:   00:20:57
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630180/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630180/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3a4db95a3b6948168621f949aeea8464

    Command failed (workunit test rados/test_crash.sh) on smithi119 with status
    1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e98897febf3caebc1072d3529f386b5f75564b2f
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_crash.sh'

[6630189]  rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:08:57
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630189/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630189/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c3fe76307c67445da9abbed889e834e2

    Command failed on smithi026 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e98897febf3caebc1072d3529f386b5f75564b2f shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fcd41da8-7a46-11ec-8c35-001a4aab830c -- ceph orch daemon add osd
    smithi026:vg_nvme/lv_4'

[6630190]  rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:36:01
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630190/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630190/

    "2022-01-20T23:36:37.091383+0000 mon.a (mon.0) 356 : cluster [WRN] Health
    check failed: 1 osds down (OSD_DOWN)" in cluster log



Dead
=================================================================
[6629956]  rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629956/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629956/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1defb59a4ddc4b10afa4d1db2ae5b451

    SSH connection to smithi133 was lost: 'uname -r'

[6629985]  rados/singleton/{all/backfill-toofull msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629985/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629985/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2f317807b7a34430a8e352d625e636d2

    SSH connection to smithi139 was lost: 'uname -r'

[6630078]  rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630078/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630078/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3d4cd12f9f45489d8a994e663a1393d8

    SSH connection to smithi036 was lost: 'uname -r'

[6630084]  rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/redirect_set_object}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630084/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630084/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f8791953564f4905a8135aeebb3a3e2e

    SSH connection to smithi038 was lost: 'uname -r'

[6630110]  rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630110/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630110/
sentry: https://sentry.ceph.com/organizations/ceph/?query=23829d7e038843b09ad768ed7d4094c0

    SSH connection to smithi082 was lost: 'uname -r'



Pass
=================================================================
[6629933] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{rhel_8}}
time:   00:19:34
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629933/

[6629934] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/repair_test}
time:   00:24:39
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629934/

[6629935] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:20:50
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629935/

[6629936] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}}
time:   00:27:30
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629936/

[6629937] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced}
time:   00:23:20
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629937/

[6629938] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard}
time:   01:08:33
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629938/

[6629939] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}}
time:   00:17:05
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629939/

[6629940] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed}
time:   00:26:36
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629940/

[6629941] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   01:06:20
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629941/

[6629942] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/workunits}
time:   00:10:12
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629942/

[6629943] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon}
time:   00:47:15
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629943/

[6629944] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:39
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629944/

[6629945] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:12:05
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629945/

[6629946] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04 start}
time:   00:13:49
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629946/

[6629947] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{ubuntu_latest}}
time:   00:08:23
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629947/

[6629948] rados/singleton/{all/thrash-eio msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}}
time:   00:33:33
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629948/

[6629949] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:20:18
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629949/

[6629952] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews}
time:   00:09:38
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629952/

[6629953] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep}
time:   00:14:06
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629953/

[6629954] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04} tasks/scrub_test}
time:   00:10:17
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629954/

[6629955] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   00:20:53
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629955/

[6629957] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big}
time:   00:20:01
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629957/

[6629958] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:20:46
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629958/

[6629959] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:09:31
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629959/

[6629960] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2}
time:   00:18:39
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629960/

[6629961] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{ubuntu_18.04}}
time:   00:16:02
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629961/

[6629962] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}}
time:   00:35:43
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629962/

[6629963] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:24:28
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629963/

[6629964] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:20:14
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629964/

[6629965] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small}
time:   00:10:18
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629965/

[6629966] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard}
time:   01:05:20
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629966/

[6629967] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:09:39
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629967/

[6629968] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_18.04}}
time:   00:06:21
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629968/

[6629969] rados/singleton-bluestore/{all/cephtool msgr-failures/none msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   00:30:31
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629969/

[6629970] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:21:49
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629970/

[6629971] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:20:57
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629971/

[6629972] rados/singleton/{all/watch-notify-same-primary msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04}}
time:   00:07:01
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629972/

[6629973] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:37:26
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629973/

[6629974] rados/singleton/{all/admin-socket msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04}}
time:   00:06:38
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629974/

[6629975] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_api_tests}
time:   00:32:09
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629975/

[6629976] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests}
time:   00:31:40
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629976/

[6629977] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_8}}
time:   00:22:31
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629977/

[6629978] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:10:46
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629978/

[6629979] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04} thrashers/sync workloads/rados_mon_workunits}
time:   00:25:52
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629979/

[6629981] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd}
time:   02:54:02
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629981/

[6629982] rados/multimon/{clusters/3 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}
time:   00:16:35
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629982/

[6629983] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind}
time:   00:42:43
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629983/

[6629984] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:23:45
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629984/

[6629986] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps}
time:   00:22:24
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629986/

[6629987] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:18
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629987/

[6629988] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:25:23
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629988/

[6629989] rados/singleton/{all/deduptool msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04}}
time:   00:07:21
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629989/

[6629990] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/failover}
time:   00:21:47
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629990/

[6629991] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 task/test_cephadm_repos}
time:   00:07:35
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629991/

[6629992] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{rhel_8}}
time:   00:27:16
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629992/

[6629993] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced}
time:   00:31:24
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629993/

[6629994] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:09:06
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629994/

[6629995] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:23:48
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629995/

[6629996] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard}
time:   01:08:08
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629996/

[6629997] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}}
time:   00:32:35
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629997/

[6629998] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}}
time:   00:11:28
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629998/

[6629999] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all}
time:   00:12:42
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6629999/

[6630000] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:25:58
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630000/

[6630001] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps}
time:   00:19:43
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630001/

[6630002] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04}}
time:   00:08:48
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630002/

[6630003] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects}
time:   00:26:29
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630003/

[6630005] rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:10:56
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630005/

[6630006] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep}
time:   00:15:41
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630006/

[6630007] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:32
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630007/

[6630009] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{rhel_8}}
time:   00:17:43
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630009/

[6630010] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:10:27
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630010/

[6630011] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:35
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630011/

[6630012] rados/singleton/{all/dump-stuck msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
time:   00:11:11
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630012/

[6630013] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache}
time:   00:25:05
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630013/

[6630014] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects}
time:   00:20:52
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630014/

[6630015] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights}
time:   00:11:45
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630015/

[6630016] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub}
time:   01:29:14
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630016/

[6630017] rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}}
time:   00:37:42
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630017/

[6630018] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_python}
time:   00:12:48
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630018/

[6630019] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/dedup_tier}
time:   00:12:34
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630019/

[6630020] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:20:29
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630020/

[6630021] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged msgr/async start tasks/rados_python}
time:   00:22:48
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630021/

[6630022] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_8}}
time:   00:37:43
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630022/

[6630023] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard}
time:   01:05:02
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630023/

[6630024] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}}
time:   04:30:35
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630024/

[6630025] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04}}
time:   00:28:51
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630025/

[6630026] rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04}}
time:   00:05:57
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630026/

[6630027] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:10:21
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630027/

[6630028] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects}
time:   00:31:19
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630028/

[6630029] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/many workloads/pool-create-delete}
time:   00:27:31
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630029/

[6630031] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:06:25
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630031/

[6630032] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind}
time:   00:28:23
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630032/

[6630033] rados/singleton/{all/lost-unfound-delete msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
time:   00:28:58
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630033/

[6630034] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:37
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630034/

[6630035] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:09:59
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630035/

[6630036] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:23:24
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630036/

[6630037] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/rados_api_tests}
time:   00:32:17
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630037/

[6630038] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 task/test_orch_cli}
time:   00:20:24
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630038/

[6630039] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_8}}
time:   00:10:35
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630039/

[6630040] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:36:33
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630040/

[6630041] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} tasks/rados_stress_watch}
time:   00:14:46
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630041/

[6630042] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:25:23
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630042/

[6630043] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/module_selftest}
time:   00:37:34
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630043/

[6630044] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:08:23
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630044/

[6630045] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:06:49
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630045/

[6630046] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:28:27
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630046/

[6630047] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/radosbench-high-concurrency}
time:   00:26:39
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630047/

[6630048] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}}
time:   00:20:59
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630048/

[6630049] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}}
time:   00:13:41
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630049/

[6630050] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard}
time:   01:14:31
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630050/

[6630051] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}}
time:   00:25:11
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630051/

[6630052] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}}
time:   00:08:27
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630052/

[6630053] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{rhel_8}}
time:   00:23:54
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630053/

[6630054] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush}
time:   00:20:03
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630054/

[6630055] rados/upgrade/mimic-x-singleton/{0-cluster/{openstack start} 1-install/mimic 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_18.04}
time:   05:42:25
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630055/

[6630056] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   00:20:11
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630056/

[6630057] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench}
time:   01:35:22
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630057/

[6630058] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925}
time:   00:18:18
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630058/

[6630060] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} tasks/mon_clock_with_skews}
time:   00:06:26
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630060/

[6630061] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep}
time:   00:22:36
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630061/

[6630062] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:32:37
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630062/

[6630063] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:20:32
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630063/

[6630064] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04}}
time:   00:10:28
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630064/

[6630065] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:09:30
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630065/

[6630066] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper}
time:   00:07:39
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630066/

[6630067] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect}
time:   00:25:54
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630067/

[6630068] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_18.04} tasks/progress}
time:   00:15:37
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630068/

[6630069] rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04}}
time:   00:08:29
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630069/

[6630070] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:34:42
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630070/

[6630071] rados/cephadm/smoke/{distro/centos_8.2_container_tools_3.0 fixed-2 start}
time:   00:14:40
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630071/

[6630072] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{ubuntu_latest}}
time:   00:07:55
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630072/

[6630073] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:19:58
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630073/

[6630074] rados/singleton/{all/mon-config-key-caps msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04}}
time:   00:09:13
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630074/

[6630075] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_promote_tests}
time:   00:21:11
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630075/

[6630076] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:11:11
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630076/

[6630077] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:21:38
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630077/

[6630079] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard}
time:   01:07:49
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630079/

[6630080] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04} thrashers/sync-many workloads/rados_api_tests}
time:   00:23:43
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630080/

[6630081] rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery}
time:   00:19:10
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630081/

[6630082] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}}
time:   00:14:01
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630082/

[6630083] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}}
time:   00:30:37
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630083/

[6630085] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:19
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630085/

[6630087] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
time:   00:44:12
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630087/

[6630088] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big}
time:   00:39:06
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630088/

[6630089] rados/cephadm/smoke-roleless/{distro/centos_8.2_container_tools_3.0 start}
time:   00:13:46
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630089/

[6630090] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{centos_8}}
time:   00:10:26
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630090/

[6630091] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:14
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630091/

[6630092] rados/singleton/{all/mon-config msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04}}
time:   00:08:13
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630092/

[6630093] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:08:48
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630093/

[6630094] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/prometheus}
time:   00:10:31
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630094/

[6630095] rados/standalone/{supported-random-distro$/{ubuntu_18.04} workloads/erasure-code}
time:   00:33:26
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630095/

[6630096] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/set-chunk-promote-flush}
time:   00:14:01
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630096/

[6630097] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:23:27
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630097/

[6630098] rados/singleton/{all/osd-backfill msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
time:   00:18:22
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630098/

[6630099] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:37:06
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630099/

[6630101] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{ubuntu_latest}}
time:   00:07:32
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630101/

[6630102] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunks-read}
time:   00:25:23
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630102/

[6630103] rados/singleton/{all/osd-recovery-incomplete msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:57
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630103/

[6630104] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix}
time:   00:29:48
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630104/

[6630105] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:12:28
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630105/

[6630106] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:23:37
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630106/

[6630107] rados/multimon/{clusters/6 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:06:20
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630107/

[6630108] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
time:   00:16:03
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630108/

[6630109] rados/singleton/{all/osd-recovery msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04}}
time:   00:12:01
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630109/

[6630111] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune}
time:   00:37:34
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630111/

[6630112] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced}
time:   00:32:40
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630112/

[6630113] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:30:00
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630113/

[6630114] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:29
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630114/

[6630115] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_18.04} tasks/dashboard}
time:   01:06:43
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630115/

[6630116] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}}
time:   00:06:48
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630116/

[6630117] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests}
time:   00:32:03
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630117/

[6630118] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{rhel_8}}
time:   00:17:01
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630118/

[6630119] rados/singleton/{all/peer msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04}}
time:   00:07:11
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630119/

[6630120] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/workunits}
time:   00:18:05
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630120/

[6630121] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized}
time:   00:23:55
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630121/

[6630122] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-radosbench}
time:   01:11:04
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630122/

[6630123] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:11:05
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630123/

[6630124] rados/singleton/{all/pg-autoscaler-progress-off msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}}
time:   00:20:01
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630124/

[6630125] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:09:55
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630125/

[6630126] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread}
time:   00:26:24
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630126/

[6630127] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects}
time:   00:28:00
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630127/

[6630128] rados/standalone/{supported-random-distro$/{ubuntu_18.04} workloads/mgr}
time:   00:09:42
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630128/

[6630129] rados/singleton/{all/pg-autoscaler msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04}}
time:   00:09:43
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630129/

[6630130] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 task/test_adoption}
time:   00:10:41
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630130/

[6630131] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{ubuntu_18.04}}
time:   00:06:34
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630131/

[6630132] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:06
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630132/

[6630133] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews}
time:   00:16:38
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630133/

[6630134] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
time:   00:28:43
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630134/

[6630136] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} thrashers/force-sync-many workloads/rados_mon_workunits}
time:   00:25:28
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630136/

[6630137] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:41:18
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630137/

[6630138] rados/singleton/{all/pg-removal-interruption msgr-failures/none msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04}}
time:   00:07:01
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630138/

[6630139] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:03
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630139/

[6630140] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:09:03
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630140/

[6630141] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_18.04} tasks/dashboard}
time:   01:07:51
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630141/

[6630142] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:09:17
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630142/

[6630143] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}}
time:   02:44:53
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630143/

[6630144] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:38:36
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630144/

[6630145] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
time:   00:22:22
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630145/

[6630146] rados/singleton/{all/radostool msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}}
time:   00:13:36
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630146/

[6630147] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced}
time:   00:29:10
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630147/

[6630148] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized}
time:   00:29:08
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630148/

[6630149] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2}
time:   00:18:19
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630149/

[6630150] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{rhel_8}}
time:   00:17:29
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630150/

[6630151] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:42:40
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630151/

[6630152] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/readwrite}
time:   00:13:56
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630152/

[6630153] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:37:37
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630153/

[6630154] rados/singleton/{all/random-eio msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04}}
time:   00:20:35
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630154/

[6630155] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:09:12
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630155/

[6630156] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects}
time:   00:36:34
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630156/

[6630158] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:36:09
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630158/

[6630159] rados/multimon/{clusters/21 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:22:54
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630159/

[6630160] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:24:28
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630160/

[6630162] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits}
time:   00:37:18
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630162/

[6630163] rados/cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_python}
time:   00:22:52
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630163/

[6630164] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{centos_8}}
time:   00:11:09
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630164/

[6630165] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:20:33
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630165/

[6630166] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed}
time:   00:15:12
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630166/

[6630167] rados/singleton/{all/recovery-preemption msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:17:31
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630167/

[6630168] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_18.04} tasks/failover}
time:   00:11:25
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630168/

[6630169] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc}
time:   00:23:41
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630169/

[6630170] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard}
time:   01:09:04
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630170/

[6630171] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}}
time:   02:33:35
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630171/

[6630172] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/repair_test}
time:   00:18:12
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630172/

[6630173] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:09:57
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630173/

[6630174] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:21:04
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630174/

[6630175] rados/singleton/{all/resolve_stuck_peering msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}}
time:   00:12:16
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630175/

[6630176] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:40:15
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630176/

[6630177] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:09:14
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630177/

[6630178] rados/cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 task/test_cephadm}
time:   00:16:10
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630178/

[6630179] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{rhel_8}}
time:   00:17:27
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630179/

[6630181] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big}
time:   00:20:23
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630181/

[6630182] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:11
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630182/

[6630183] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_18.04}
time:   03:30:31
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630183/

[6630184] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:19:52
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630184/

[6630185] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04}}
time:   00:13:48
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630185/

[6630186] rados/multimon/{clusters/3 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:06:21
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630186/

[6630187] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
time:   01:07:57
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630187/

[6630188] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:10:25
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630188/

[6630191] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:16
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630191/

[6630192] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small}
time:   00:19:47
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630192/

[6630193] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/insights}
time:   00:22:38
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630193/

[6630194] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/scrub_test}
time:   00:13:29
info:   http://pulpito.ceph.com/yuriw-2022-01-20_20:58:52-rados-wip-yuri3-testing-2022-01-19-1401-octopus-distro-default-smithi/6630194/