2024-04-12T08:56:27.758 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-12T08:56:27.758 INFO:teuthology.results:seed: '2720'
2024-04-12T08:57:15.053 INFO:root:teuthology version: 0.0.1.dev249+gcd45576
2024-04-12T08:57:15.057 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2024-04-12T09:25:17.193 INFO:teuthology.results:Tests finished! gathering results...
2024-04-12T09:25:17.317 INFO:scrape:Found 2 jobs
2024-04-12T09:25:17.361 INFO:scrape:Found 1 distinct failure reasons
2024-04-12T09:25:17.361 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-64502-quincy-2
2024-04-12T09:25:17.361 INFO:scrape:2 jobs: ['7653754', '7653753']
2024-04-12T09:25:17.361 INFO:scrape:suites intersection: ['1-ranks/1', '1-volume/{0-create', '2-client/fuse', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/quincy']
2024-04-12T09:25:17.361 INFO:scrape:suites union: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/fuse', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_9.stream', 'conf/{client', 'fail_fs/no', 'fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mgr', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'pg_health', 'roles', 'syntax}', 'tasks/{0-from/quincy']
2024-04-12T09:25:17.361 INFO:scrape:
2024-04-12T09:25:17.362 INFO:teuthology.results:Sending results to vshankar@redhat.com: Test Run: vshankar-2024-04-12_08:53:53-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi
=================================================================
info:    https://pulpito.ceph.com/vshankar-2024-04-12_08:53:53-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/vshankar-2024-04-12_08:53:53-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[7653753]  fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:06:44
info:   https://pulpito.ceph.com/vshankar-2024-04-12_08:53:53-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653753/
log:    http://qa-proxy.ceph.com/teuthology/vshankar-2024-04-12_08:53:53-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653753/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0dca93fcef40436e8ce83c7409649b57

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-
    64502-quincy-2

[7653754]  fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:08:09
info:   https://pulpito.ceph.com/vshankar-2024-04-12_08:53:53-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653754/
log:    http://qa-proxy.ceph.com/teuthology/vshankar-2024-04-12_08:53:53-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7653754/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9ad5b473b12442d3a2a5c91f021c6c80

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-
    64502-quincy-2