2021-10-22T16:13:08.794 INFO:root:teuthology version: 1.1.0-c56135d1 2021-10-22T16:13:08.795 INFO:teuthology.results:subset: '3600/9999' 2021-10-22T16:13:08.796 INFO:teuthology.results:seed: '1124' 2021-10-22T19:13:44.966 INFO:root:teuthology version: 1.1.0-c56135d1 2021-10-22T19:13:45.004 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-22T19:45:47.478 INFO:teuthology.results:Tests finished! gathering results... 2021-10-22T19:45:59.716 INFO:scrape:Found 152 jobs 2021-10-22T19:46:14.813 INFO:scrape:Found 3 distinct failure reasons 2021-10-22T19:46:14.814 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=7860f3d77ee3e58c18067dbf7c5e3242c90d9096 2021-10-22T19:46:14.815 INFO:scrape:150 jobs 2021-10-22T19:46:14.816 INFO:scrape:suites intersection: [] 2021-10-22T19:46:14.817 INFO:scrape:suites union: ['cachepool/none', 'cachepool/small', 'centos_latest', 'clients/mirror', 'clients/{mirror-extra', 'cluster/{2-node', 'cluster/{fixed-3', 'clusters/{fixed-1', 'clusters/{fixed-2', 'clusters/{fixed-3', 'config/copy-on-read', 'config/none', 'config/permit-partial-discard', 'features/defaults', 'features/format-1', 'features/journaling', 'features/layering', 'features/readbalance', 'min-compat-client/default', 'min-compat-client/octopus', 'mirror}', 'msgr-failures/few', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack', 'openstack}', 'policy/none', 'policy/simple', 'pool/ceph_and_immutable_object_cache', 'pool/ec-cache-pool', 'pool/ec-data-pool', 'pool/none', 'pool/replicated-data-pool', 'pool/small-cache-pool', 'qemu/xfstests', 'rbd-mirror/four-per-cluster', 'rbd/basic/{base/install', 'rbd/cli/{base/install', 'rbd/cli_v1/{base/install', 'rbd/immutable-object-cache/{clusters/{fix-2', 'rbd/librbd/{cache/none', 'rbd/librbd/{cache/writearound', 'rbd/librbd/{cache/writeback', 'rbd/librbd/{cache/writethrough', 'rbd/maintenance/{base/install', 'rbd/mirror-thrash/{base/install', 'rbd/mirror/{base/install', 'rbd/nbd/{base/install', 'rbd/qemu/{cache/none', 'rbd/qemu/{cache/writearound', 'rbd/qemu/{cache/writeback', 'rbd/qemu/{cache/writethrough', 'rbd/singleton-bluestore/{all/issue-20295', 'rbd/singleton/{all/admin_socket', 'rbd/singleton/{all/formatted-output', 'rbd/singleton/{all/merge_diff', 'rbd/singleton/{all/permissions', 'rbd/singleton/{all/qemu-iotests-no-cache', 'rbd/singleton/{all/qemu-iotests-writearound', 'rbd/singleton/{all/qemu-iotests-writeback', 'rbd/singleton/{all/qemu-iotests-writethrough', 'rbd/singleton/{all/qos', 'rbd/singleton/{all/rbd-vs-unmanaged-snaps', 'rbd/singleton/{all/rbd_mirror', 'rbd/singleton/{all/rbd_tasks', 'rbd/singleton/{all/rbdmap_RBDMAPFILE', 'rbd/singleton/{all/read-flags-no-cache', 'rbd/singleton/{all/read-flags-writeback', 'rbd/singleton/{all/read-flags-writethrough', 'rbd/singleton/{all/snap-diff', 'rbd/singleton/{all/verify_pool', 'rbd/thrash/{base/install', 'rbd/valgrind/{base/install', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_18.04}', 'supported-random-distro$/{ubuntu_18.04}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rbd_api_tests_old_format}', 'tasks/rbd_cls_tests}', 'tasks/rbd_lock_and_fence}', 'tasks/rbd_python_api_tests_old_format}', 'thrashers/cache', 'thrashers/default', 'thrashosds-health', 'validator/memcheck', 'workloads/c_api_tests_with_defaults}', 'workloads/c_api_tests_with_journaling}', 'workloads/c_api_tests}', 'workloads/dynamic_features_no_cache}', 'workloads/dynamic_features}', 'workloads/fio_on_immutable_object_cache}', 'workloads/fsx}', 'workloads/journal}', 'workloads/python_api_tests_with_defaults}', 'workloads/python_api_tests_with_journaling}', 'workloads/python_api_tests}', 'workloads/qemu_bonnie}', 'workloads/qemu_fsstress}', 'workloads/qemu_on_immutable_object_cache_and_thrash}', 'workloads/qemu_xfstests}', 'workloads/rbd-mirror-fsx-workunit}', 'workloads/rbd-mirror-ha-workunit}', 'workloads/rbd-mirror-journal-bootstrap-workunit}', 'workloads/rbd-mirror-journal-stress-workunit}', 'workloads/rbd-mirror-journal-workunit}', 'workloads/rbd-mirror-snapshot-bootstrap-workunit}', 'workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-stress-workunit-fast-diff}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}', 'workloads/rbd-mirror-snapshot-workunit-exclusive-lock}', 'workloads/rbd-mirror-snapshot-workunit-fast-diff}', 'workloads/rbd-mirror-snapshot-workunit-journaling}', 'workloads/rbd-mirror-snapshot-workunit-minimum}', 'workloads/rbd-mirror-stress-workunit-min-compat-client-octopus}', 'workloads/rbd-mirror-workunit-config-key}', 'workloads/rbd-mirror-workunit-min-compat-client-octopus}', 'workloads/rbd-mirror-workunit-policy-none}', 'workloads/rbd-mirror-workunit-policy-simple}', 'workloads/rbd_api_tests_copy_on_read}', 'workloads/rbd_api_tests_journaling}', 'workloads/rbd_api_tests_no_locking}', 'workloads/rbd_api_tests}', 'workloads/rbd_cli_generic}', 'workloads/rbd_cli_groups}', 'workloads/rbd_cli_import_export}', 'workloads/rbd_fio}', 'workloads/rbd_fsx_cache_writearound}', 'workloads/rbd_fsx_cache_writeback}', 'workloads/rbd_fsx_cache_writethrough}', 'workloads/rbd_fsx_copy_on_read}', 'workloads/rbd_fsx_deep_copy}', 'workloads/rbd_fsx_journal}', 'workloads/rbd_fsx_nbd}', 'workloads/rbd_fsx_nocache}', 'workloads/rbd_fsx_rate_limit}', 'workloads/rbd_mirror}', 'workloads/rbd_nbd}', 'workloads/rebuild_object_map}'] 2021-10-22T19:46:14.817 INFO:scrape: 2021-10-22T19:46:14.818 INFO:scrape:Failure: reached maximum tries (60) after waiting for 900 seconds 2021-10-22T19:46:14.818 INFO:scrape:1 jobs: ['6454104'] 2021-10-22T19:46:14.818 INFO:scrape: 2021-10-22T19:46:14.819 INFO:scrape:Failure: Failed to power on gibba027 2021-10-22T19:46:14.819 INFO:scrape:1 jobs: ['6454102'] 2021-10-22T19:46:14.820 INFO:scrape: 2021-10-22T19:46:14.825 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/ failed: 150 dead: 2 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [6454100] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 00:04:16 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454100/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c4dd38f54a2455cb4f3f63e45bbe4de Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454101] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_18.04} workloads/rbd-mirror-workunit-config-key} ----------------------------------------------------------------- time: 00:02:57 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454101/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454101/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7f2dc0734c684e1bb6b38605a208e30f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454103] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:05:08 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454103/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454103/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8891462707b4cc78a6692ec0832e3c7 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454105] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/rbd_cls_tests} ----------------------------------------------------------------- time: 00:04:09 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454105/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454105/ sentry: https://sentry.ceph.com/organizations/ceph/?query=02ece51500d042bf83c0545eee015f6a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454106] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/python_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:04:09 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454106/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454106/ sentry: https://sentry.ceph.com/organizations/ceph/?query=15dfbb3b6dd0496abb447deb51d25739 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454107] rbd/singleton/{all/read-flags-no-cache objectstore/filestore-xfs openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:00 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454107/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454107/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2fda8f14863340f099c38d791c206ed2 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454108] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:04:18 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454108/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454108/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91c1cedb309549ceb3473c0198de687a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454109] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib thrashers/cache thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454109/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454109/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dddb9a86713d4d65a9d2a49e7c43bc3f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454110] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 00:03:25 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454110/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454110/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba420846dcbb4dae91bb155cbbd6fa3f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454111] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:05:07 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454111/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454111/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1f8779822a71459d97b512d61b1cca58 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454112] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/none rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 00:04:15 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454112/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454112/ sentry: https://sentry.ceph.com/organizations/ceph/?query=73e523f9cd114c7b842a797cdd9ff48a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454113] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zstd pool/replicated-data-pool supported-random-distro$/{ubuntu_18.04} workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454113/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454113/ sentry: https://sentry.ceph.com/organizations/ceph/?query=97505c5006c54d199d3b4b81159e1728 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454114] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_journal} ----------------------------------------------------------------- time: 00:05:12 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454114/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454114/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9fa3bcb1affc42ed99dfb73b43dfa8ce Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454115] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:03:01 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454115/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454115/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b2d348904e25448bb2155b85e5681493 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454116] rbd/singleton/{all/read-flags-writeback objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:03 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454116/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454116/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3074b212fa74d09b002031cfac4c1a5 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454117] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{ubuntu_18.04} workloads/qemu_fsstress} ----------------------------------------------------------------- time: 00:03:17 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454117/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454117/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1a818af8d7d442fb602e1fc74dee953 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454118] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 00:02:58 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454118/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454118/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b801cffad6f4c7498cd4faa45ed95fa Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454119] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-bitmap validator/memcheck workloads/python_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:04:12 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454119/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454119/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a1693fd3c20c470bad4329e4f48daa46 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454120] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{ubuntu_18.04} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:03:11 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454120/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454120/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4842862aaae84dbdac864f530d73f426 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454121] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-none} ----------------------------------------------------------------- time: 00:03:10 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454121/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454121/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0fa112695cb46a5b0e331dc0434a43d Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454122] rbd/singleton/{all/read-flags-writethrough objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:02:59 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454122/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454122/ sentry: https://sentry.ceph.com/organizations/ceph/?query=855cca0a7e024d62a2a95c5b6b0df289 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454123] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{ubuntu_18.04} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:02:50 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454123/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454123/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ea4be16656f447bb3e61503303c0ed1 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454124] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd thrashers/default thrashosds-health workloads/rbd_fsx_nbd} ----------------------------------------------------------------- time: 00:03:23 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454124/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454124/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a94453fd3e234657bf34ed6fee4d95e6 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454125] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_nocache} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454125/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454125/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bcd3b09c09914ac5ae010b3affac046b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454126] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-stress-workunit} ----------------------------------------------------------------- time: 00:03:07 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454126/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454126/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8fa36783ceb643e781d1f62e04e5a775 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454127] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:04:19 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454127/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454127/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9deef3bfab604e158b49b5007bcd76f2 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454128] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:04:11 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454128/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454128/ sentry: https://sentry.ceph.com/organizations/ceph/?query=69134e653abe4923ac6d831f29376c1c Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454129] rbd/singleton/{all/snap-diff objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_18.04}} ----------------------------------------------------------------- time: 00:02:50 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454129/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454129/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39cc78668e9846deb2dafdcdb092bdd9 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454130] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-cache-pool supported-random-distro$/{centos_8} workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:04:32 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454130/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454130/ sentry: https://sentry.ceph.com/organizations/ceph/?query=50ac403e9505483fbeca396cd18774d7 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454131] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454131/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454131/ sentry: https://sentry.ceph.com/organizations/ceph/?query=320c662b7c624c89aa49332c05e84e66 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454132] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-policy-simple} ----------------------------------------------------------------- time: 00:03:12 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454132/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454132/ sentry: https://sentry.ceph.com/organizations/ceph/?query=73289e4ffcc4463b9ea2d28f57b0b5ba Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454133] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_rate_limit} ----------------------------------------------------------------- time: 00:05:04 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454133/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454133/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9e6b142cd7ba444fb1c8ca5f3de219b6 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454134] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 00:03:05 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454134/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454134/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec91e73eac704f59893172ffa4821e97 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454135] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-lz4 validator/memcheck workloads/rbd_mirror} ----------------------------------------------------------------- time: 00:04:16 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454135/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454135/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b4b6c9ed301468bbb7249e53b1ce4f4 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454136] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:04:12 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454136/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454136/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd98beac31b549aa86c39b2f93488a3e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454137] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-hybrid thrashers/cache thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454137/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454137/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f0967dfb27804c8b814efb131f1f5ac6 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454138] rbd/singleton/{all/verify_pool objectstore/bluestore-comp-zlib openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:04 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454138/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454138/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc8adeb100b7454090ae9484cfabe131 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454139] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_18.04} workloads/rbd-mirror-journal-workunit} ----------------------------------------------------------------- time: 00:03:03 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454139/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454139/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ee313dbb15e450cac5997be14045ff7 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454140] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/ec-data-pool supported-random-distro$/{centos_8} workloads/fsx} ----------------------------------------------------------------- time: 00:04:53 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454140/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454140/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb09cb0dac664ad4a9ef076956af12b7 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454141] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_groups} ----------------------------------------------------------------- time: 00:05:04 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454141/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454141/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92cc8908ddaa4abb8e25825d5a36fb1d Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454142] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{ubuntu_18.04} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 00:03:15 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454142/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454142/ sentry: https://sentry.ceph.com/organizations/ceph/?query=342a5d912610447baf04f58f66e3ef0a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454143] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_18.04} workloads/rbd-mirror-ha-workunit} ----------------------------------------------------------------- time: 00:03:00 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454143/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454143/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11ebb5c4a8df4ad78af319ed7d2f3f2b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454144] rbd/singleton/{all/admin_socket objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:02:59 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454144/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454144/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3389657f0dc74babac95e7b056833dd9 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454145] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/journal} ----------------------------------------------------------------- time: 00:04:19 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454145/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454145/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dd8c8fef9f3d42ef87515f12558238f9 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454146] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:05:14 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454146/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454146/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e00c0b7aa2d74bd6b2fa964d2212c149 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454147] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/small-cache-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:05:04 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454147/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454147/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ba81becb4874176af0ce6a7b2e37745 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454148] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{ubuntu_latest} workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:03:13 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454148/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454148/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5142ba73dc4c4846a481b0adf8cbeb54 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454149] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target thrashers/default thrashosds-health workloads/rbd_fsx_nbd} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454149/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454149/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d3d130e5e304a759bb1009d6a789d40 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454150] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:13 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454150/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454150/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e588352e9af640c580f0127771840d01 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454151] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_18.04} tasks/rbd_api_tests_old_format} ----------------------------------------------------------------- time: 00:02:49 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454151/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454151/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8c4ff9e68dba4da1bdf235cf1cd0405b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454152] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-snappy validator/memcheck workloads/c_api_tests} ----------------------------------------------------------------- time: 00:04:27 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454152/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454152/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3786210e195343ce82d98337ed44db78 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454153] rbd/singleton/{all/formatted-output objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_18.04}} ----------------------------------------------------------------- time: 00:02:47 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454153/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454153/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a3ee7fd709742b3be2489e7c491ec9f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454154] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:04:16 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454154/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454154/ sentry: https://sentry.ceph.com/organizations/ceph/?query=448a278f546d4909943c0fc6ed41f440 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454155] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests} ----------------------------------------------------------------- time: 00:03:14 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454155/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454155/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1aabd421ee6f4babb9d04908316181f9 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454156] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{centos_8} workloads/python_api_tests} ----------------------------------------------------------------- time: 00:04:17 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454156/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454156/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f3fc89a4e7ba436fa2ba8b125b99edff Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454157] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-lz4 qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 00:03:20 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454157/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454157/ sentry: https://sentry.ceph.com/organizations/ceph/?query=902e643b8f0949b4b0bf962f526eb475 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454158] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-journal-bootstrap-workunit} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454158/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454158/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6c90437cf7a4438f8871adc4caff545b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454159] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-hybrid pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:05:02 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454159/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454159/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06af7c0c142945109f2224451291bcc3 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454160] rbd/singleton/{all/merge_diff objectstore/bluestore-hybrid openstack supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:02:58 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454160/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454160/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c6bd853a9e8940c5ab755e079ee066ab Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454161] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/none supported-random-distro$/{ubuntu_18.04} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:02:53 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454161/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454161/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2bec4e46594f40f4b36fcdb4db7d3b9d Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454162] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-stupid thrashers/cache thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:03:21 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454162/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454162/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c1ee1d1d732442ce8434dc4a3b283302 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454163] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/filestore-xfs pool/none supported-random-distro$/{rhel_8} workloads/qemu_fsstress} ----------------------------------------------------------------- time: 00:05:12 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454163/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454163/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac594db804ed4877a79ad59180ec15c2 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454164] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_18.04} tasks/rbd_cls_tests} ----------------------------------------------------------------- time: 00:02:52 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454164/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454164/ sentry: https://sentry.ceph.com/organizations/ceph/?query=504b4a553b0d4043b7b83b1b09ac1f8c Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454165] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zlib validator/memcheck workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:04:18 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454165/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454165/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce1000e742174896a8a8b7b9477120c8 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454166] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} ----------------------------------------------------------------- time: 00:03:09 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454166/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454166/ sentry: https://sentry.ceph.com/organizations/ceph/?query=35ea8e36251f4056ae77cd8c590c8422 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454167] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-snappy qemu/xfstests supported-random-distro$/{ubuntu_18.04} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:03:11 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454167/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454167/ sentry: https://sentry.ceph.com/organizations/ceph/?query=548bced5915a4104ada6dfce60231e2b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454168] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-bootstrap-workunit} ----------------------------------------------------------------- time: 00:03:08 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454168/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454168/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b3ea6bfbf58e47ffb79c87a78d7271f6 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454169] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_18.04} workloads/rbd-mirror-snapshot-stress-workunit-fast-diff} ----------------------------------------------------------------- time: 00:03:00 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454169/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454169/ sentry: https://sentry.ceph.com/organizations/ceph/?query=44411fece58343bc98521ee354232958 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454170] rbd/singleton/{all/permissions objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:02:59 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454170/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454170/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9d871ecacd54f78bb7a47bae3798987 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454171] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/octopus msgr-failures/few objectstore/filestore-xfs pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/python_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:04:18 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454171/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454171/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d27f52e76f2a488391d02072ce047b9a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454172] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:02:57 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454172/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454172/ sentry: https://sentry.ceph.com/organizations/ceph/?query=30ca00260af640468c3a62282dcfe5ce Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454173] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/filestore-xfs thrashers/default thrashosds-health workloads/rbd_fsx_nbd} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454173/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454173/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a6641423ad54dc288958674af7d0571 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454174] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-low-osd-mem-target pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:03:00 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454174/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454174/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1603f866d2b648dd8d167a71965ce057 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454175] rbd/singleton/{all/qemu-iotests-no-cache objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:02:58 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454175/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454175/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d0aa89ea52a64178acfc9231b10abb2a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454176] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_api_tests_journaling} ----------------------------------------------------------------- time: 00:03:09 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454176/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454176/ sentry: https://sentry.ceph.com/organizations/ceph/?query=052c167495ae41e79ac3ad5c633065a4 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454177] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/replicated-data-pool supported-random-distro$/{ubuntu_18.04} workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:03:14 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454177/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454177/ sentry: https://sentry.ceph.com/organizations/ceph/?query=499c9e28ccde4350ae4ea7d43c02aeaa Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454178] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zlib qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 00:04:25 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454178/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454178/ sentry: https://sentry.ceph.com/organizations/ceph/?query=816fcc0545204de48bb7c48eb053e241 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454179] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-workunit-exclusive-lock} ----------------------------------------------------------------- time: 00:03:07 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454179/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454179/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a0e993e90db64558ac787ec31464bfd1 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454180] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 00:04:13 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454180/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454180/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ece9d7f880444a6ae771174d4be434b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454181] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-comp-zstd validator/memcheck workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454181/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454181/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ddd1bf46e9d468c97307dfba9385016 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454182] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/filestore-xfs policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 00:05:04 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454182/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454182/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c98c2e06467143969c45a671bcabf0f3 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454183] rbd/singleton/{all/qemu-iotests-writearound objectstore/filestore-xfs openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:07 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454183/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454183/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3fff29e45a5744ebbab17aa888b0950e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454184] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/none min-compat-client/default msgr-failures/few objectstore/bluestore-bitmap pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/python_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:03:52 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454184/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454184/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8b257a3262f74c7492959f6dd50d083c Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454185] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/rbd_api_tests_no_locking} ----------------------------------------------------------------- time: 00:02:57 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454185/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454185/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6627f1f2ba004b368a2978d5ce1c0c3e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454186] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-bitmap pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:02:59 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454186/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454186/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b1be553042334f7b960c64a673212b3c Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454187] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-bitmap thrashers/cache thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454187/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454187/ sentry: https://sentry.ceph.com/organizations/ceph/?query=537a6fd5cb2442b8802adcf8e4b92b55 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454188] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-stupid pool/replicated-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_groups} ----------------------------------------------------------------- time: 00:04:16 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454188/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454188/ sentry: https://sentry.ceph.com/organizations/ceph/?query=74c74195cbfe4093b7395fed51c3c8b4 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454189] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-comp-zstd qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 00:03:57 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454189/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=00a5af9e42b348a99a142f89cf30eb5f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454190] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-workunit-fast-diff} ----------------------------------------------------------------- time: 00:04:28 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454190/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454190/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6f6d112ea8d642db835256355b0b6766 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454191] rbd/singleton/{all/qemu-iotests-writeback objectstore/bluestore-bitmap openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:19 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454191/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454191/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d043e1f611744d8aa655a8f15d5c110f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454192] rbd/qemu/{cache/writeback clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454192/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454192/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2beef4f270a466cad1450be49291ca0 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454193] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/rbd_python_api_tests_old_format} ----------------------------------------------------------------- time: 00:04:28 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454193/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454193/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a7fe95826f894bbfa5c3d87ce6a5e2de Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454194] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-hybrid validator/memcheck workloads/fsx} ----------------------------------------------------------------- time: 00:04:22 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454194/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454194/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b81a36da052241f7b1974edfeb5728bc Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454195] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-bitmap policy/none rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_18.04} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 00:03:25 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454195/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454195/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c38f5dbf8394badbcfb13dd8b7b3a74 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454196] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writearound} ----------------------------------------------------------------- time: 00:03:30 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454196/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454196/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d4d408a7dcd4f41942d71c62acd5247 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454197] rbd/singleton/{all/qemu-iotests-writethrough objectstore/bluestore-comp-lz4 openstack supported-random-distro$/{ubuntu_18.04}} ----------------------------------------------------------------- time: 00:03:03 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454197/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454197/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0c2991d715934d89bc09296cc9055acb Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454198] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-lz4 pool/small-cache-pool supported-random-distro$/{ubuntu_18.04} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:03:02 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454198/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454198/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b21be52468d84b4aa375d5e7a95abc47 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454199] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{rhel_8} workloads/fio_on_immutable_object_cache} ----------------------------------------------------------------- time: 00:05:19 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454199/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454199/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3d380be57ba34e26a231c9a5ef255d96 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454200] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 thrashers/default thrashosds-health workloads/rbd_fsx_nbd} ----------------------------------------------------------------- time: 00:03:47 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454200/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454200/ sentry: https://sentry.ceph.com/organizations/ceph/?query=846f5abe7c4e4e90b4fb8c03ce0f9939 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454201] rbd/librbd/{cache/writethrough clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 pool/ec-data-pool supported-random-distro$/{rhel_8} workloads/rbd_fio} ----------------------------------------------------------------- time: 00:05:32 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454201/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454201/ sentry: https://sentry.ceph.com/organizations/ceph/?query=639454a0249942f1b0fcbf66147bdd8a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454203] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-hybrid qemu/xfstests supported-random-distro$/{ubuntu_latest} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:03:27 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454203/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454203/ sentry: https://sentry.ceph.com/organizations/ceph/?query=86b3c16f93f24746a5ff6fa3da17b8d2 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454205] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} workloads/rbd-mirror-snapshot-workunit-journaling} ----------------------------------------------------------------- time: 00:05:17 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454205/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454205/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b04e725b034c4840903e6c12dfc4d509 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454207] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/filestore-xfs pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:03:14 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454207/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454207/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a0119884df31478c9cf18a3c28af771c Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454209] rbd/singleton/{all/qos objectstore/bluestore-comp-snappy openstack supported-random-distro$/{ubuntu_18.04}} ----------------------------------------------------------------- time: 00:03:01 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454209/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454209/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e4dcc5a05e7b48a7973b0c16ac899a4b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454210] rbd/qemu/{cache/writethrough clusters/{fixed-3 openstack} features/readbalance msgr-failures/few objectstore/bluestore-comp-snappy pool/ec-cache-pool supported-random-distro$/{rhel_8} workloads/qemu_fsstress} ----------------------------------------------------------------- time: 00:05:22 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454210/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9d62f062f3bb4cff8276648faaf402db Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454212] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_cache_writeback} ----------------------------------------------------------------- time: 00:05:21 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454212/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454212/ sentry: https://sentry.ceph.com/organizations/ceph/?query=38c209c2cd09486782f828b86f905b2e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454214] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/rbd_api_tests_old_format} ----------------------------------------------------------------- time: 00:05:18 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454214/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454214/ sentry: https://sentry.ceph.com/organizations/ceph/?query=38a49301904c42588efdfd64ddc32391 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454216] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-low-osd-mem-target validator/memcheck workloads/python_api_tests} ----------------------------------------------------------------- time: 00:04:23 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454216/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454216/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df0d7df3201f41279a0f4b6d70b6e629 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454218] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-lz4 policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-fsx-workunit} ----------------------------------------------------------------- time: 00:04:32 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454218/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454218/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bc5c1197e9164a8da79d4616bbafc833 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454219] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{rhel_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454219/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454219/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b5b9ca77914f4e72ba55a9df1d185763 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454221] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-snappy thrashers/cache thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454221/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454221/ sentry: https://sentry.ceph.com/organizations/ceph/?query=31d57dc2cd04416e8eb82dac2f9de900 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454223] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-low-osd-mem-target qemu/xfstests supported-random-distro$/{centos_8} workloads/dynamic_features_no_cache} ----------------------------------------------------------------- time: 00:04:15 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454223/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8846335582d74dfbaa525a1956f45fd0 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454225] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_18.04} workloads/rbd-mirror-snapshot-workunit-minimum} ----------------------------------------------------------------- time: 00:02:57 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454225/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454225/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3d399c86699f4d969519bd88efc04220 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454226] rbd/singleton/{all/rbd-vs-unmanaged-snaps objectstore/bluestore-comp-zlib openstack supported-random-distro$/{ubuntu_18.04}} ----------------------------------------------------------------- time: 00:02:49 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454226/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=692f99793d6e48b69ae9f8f98d36c980 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454228] rbd/librbd/{cache/none clusters/{fixed-3 openstack} config/copy-on-read min-compat-client/default msgr-failures/few objectstore/bluestore-comp-snappy pool/none supported-random-distro$/{centos_8} workloads/c_api_tests} ----------------------------------------------------------------- time: 00:04:38 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454228/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454228/ sentry: https://sentry.ceph.com/organizations/ceph/?query=64141cbdaa8e4807afb19eddcc939eac Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454230] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_18.04} thrashers/cache thrashosds-health workloads/rbd_fsx_cache_writethrough} ----------------------------------------------------------------- time: 00:03:10 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454230/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7933965964d94b51b1dd2b6191649c32 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454232] rbd/cli/{base/install clusters/{fixed-1 openstack} features/defaults msgr-failures/few objectstore/bluestore-bitmap pool/ec-data-pool supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:04:15 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454232/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454232/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e46c223d2b64454b394f08728d62ca3 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454234] rbd/singleton/{all/rbd_mirror objectstore/bluestore-comp-zstd openstack supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:03:02 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454234/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454234/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4202a97a32484b2387a8947cde0a9058 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454235] rbd/qemu/{cache/none clusters/{fixed-3 openstack} features/defaults msgr-failures/few objectstore/bluestore-comp-zlib pool/ec-data-pool supported-random-distro$/{ubuntu_18.04} workloads/qemu_xfstests} ----------------------------------------------------------------- time: 00:03:14 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454235/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454235/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd1748eec2644f80baa98c940012f6f5 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454237] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-stupid qemu/xfstests supported-random-distro$/{ubuntu_18.04} workloads/rebuild_object_map} ----------------------------------------------------------------- time: 00:03:12 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454237/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454237/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a25b0228f5349368f67af719fbf679c Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454239] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} workloads/rbd-mirror-stress-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:05:08 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454239/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454239/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25a7563ec0dd4ff2a078724c6505ef2a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454241] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-snappy policy/none rbd-mirror/four-per-cluster supported-random-distro$/{rhel_8} workloads/rbd-mirror-journal-stress-workunit} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454241/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454241/ sentry: https://sentry.ceph.com/organizations/ceph/?query=23146331c1a64d81afb3b6fb0b3b261e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454242] rbd/basic/{base/install cachepool/none clusters/{fixed-1 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/rbd_cls_tests} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454242/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454242/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9b349002499940549552f6594882ee86 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454243] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/bluestore-stupid validator/memcheck workloads/python_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:04:13 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454243/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454243/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f9664c00c86f4f059fdf298df72bd43c Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454244] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zlib pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:03:01 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454244/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454244/ sentry: https://sentry.ceph.com/organizations/ceph/?query=567ae39dc26a441c9d554d6c2216e922 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454245] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zlib thrashers/default thrashosds-health workloads/rbd_fsx_nbd} ----------------------------------------------------------------- time: 00:03:24 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454245/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454245/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e80ee618b96b4a7da8e41a0b8a66339d Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454246] rbd/singleton-bluestore/{all/issue-20295 objectstore/bluestore-comp-snappy openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:07 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454246/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b75790ce4ea8489b9bd54315ea8d2e3e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454247] rbd/singleton/{all/rbd_tasks objectstore/bluestore-hybrid openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:03 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454247/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454247/ sentry: https://sentry.ceph.com/organizations/ceph/?query=56766891d3f44eaabac29cf2391aee5e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454248] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_copy_on_read} ----------------------------------------------------------------- time: 00:03:10 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454248/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454248/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0312e971a7424eb09dd65db28483d7b9 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454250] rbd/librbd/{cache/writearound clusters/{fixed-3 openstack} config/none min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-zlib pool/replicated-data-pool supported-random-distro$/{ubuntu_18.04} workloads/c_api_tests_with_defaults} ----------------------------------------------------------------- time: 00:03:08 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454250/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454250/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6c468a2c073e4ba39c2a43064b1c62ab Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454252] rbd/cli/{base/install clusters/{fixed-1 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-lz4 pool/none supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:02:59 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454252/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454252/ sentry: https://sentry.ceph.com/organizations/ceph/?query=67f283597b8a4f0fadc07f66b7ba6ad0 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454254] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/filestore-xfs qemu/xfstests supported-random-distro$/{ubuntu_18.04} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:03:13 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454254/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454254/ sentry: https://sentry.ceph.com/organizations/ceph/?query=81753c9e2e724251a36bc75de3a1bcd0 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454255] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-workunit-config-key} ----------------------------------------------------------------- time: 00:03:11 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454255/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454255/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f0992c6176c405c8af7db586b24665b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454257] rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-low-osd-mem-target openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:03 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454257/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454257/ sentry: https://sentry.ceph.com/organizations/ceph/?query=adde5ec7fe464078bdbf6256c78ef9c1 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454259] rbd/qemu/{cache/writearound clusters/{fixed-3 openstack} features/journaling msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{centos_8} workloads/qemu_bonnie} ----------------------------------------------------------------- time: 00:04:16 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454259/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ab6bee1cd4d4f0f80052b7c0f482947 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454261] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-comp-zstd pool/none supported-random-distro$/{centos_8} workloads/rbd_cli_import_export} ----------------------------------------------------------------- time: 00:04:09 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454261/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454261/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5e4bd9ddf6054bf79c2280d70d60c070 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454263] rbd/nbd/{base/install cluster/{fixed-3 openstack} msgr-failures/few objectstore/bluestore-comp-zstd thrashers/cache thrashosds-health workloads/rbd_nbd} ----------------------------------------------------------------- time: 00:03:20 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454263/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454263/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0974fae45c364b2f8aaec6bd0aebf52a Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454265] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-comp-zlib policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-journal-workunit} ----------------------------------------------------------------- time: 00:04:15 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454265/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454265/ sentry: https://sentry.ceph.com/organizations/ceph/?query=724964b0a4274635835435abbb28d25d Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454267] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} thrashers/cache thrashosds-health workloads/rbd_fsx_deep_copy} ----------------------------------------------------------------- time: 00:05:03 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454267/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454267/ sentry: https://sentry.ceph.com/organizations/ceph/?query=165c9f4bffd44c32b5f4d543a8ee7255 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454269] rbd/basic/{base/install cachepool/small clusters/{fixed-1 openstack} msgr-failures/few objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/rbd_lock_and_fence} ----------------------------------------------------------------- time: 00:05:02 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454269/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=53df798324294175a8d7b52769b09c02 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454271] rbd/valgrind/{base/install centos_latest clusters/{fixed-1 openstack} objectstore/filestore-xfs validator/memcheck workloads/python_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454271/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454271/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d639a1be3aaf4e9dbfe7614a35720c5b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454273] rbd/singleton/{all/read-flags-no-cache objectstore/bluestore-stupid openstack supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454273/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454273/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1bc090cd3a3841ab8c8b2eda26b236e0 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454275] rbd/librbd/{cache/writeback clusters/{fixed-3 openstack} config/permit-partial-discard min-compat-client/default msgr-failures/few objectstore/bluestore-comp-zstd pool/small-cache-pool supported-random-distro$/{centos_8} workloads/c_api_tests_with_journaling} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454275/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454275/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7ad5b1927fc946f792292dc20d272e85 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454277] rbd/maintenance/{base/install clusters/{fixed-3 openstack} objectstore/bluestore-bitmap qemu/xfstests supported-random-distro$/{rhel_8} workloads/dynamic_features} ----------------------------------------------------------------- time: 00:05:09 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454277/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454277/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9273634757184f5fbf3ef5743a463637 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454278] rbd/mirror/{base/install clients/{mirror-extra mirror} cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} workloads/rbd-mirror-workunit-min-compat-client-octopus} ----------------------------------------------------------------- time: 00:05:06 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454278/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454278/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b90b5829c5334b81b1e1b6dd29d03a06 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454280] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rbd_fsx_journal} ----------------------------------------------------------------- time: 00:05:05 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454280/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454280/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2abadb350a05453d8189894ef81973a8 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454282] rbd/cli/{base/install clusters/{fixed-1 openstack} features/layering msgr-failures/few objectstore/bluestore-comp-snappy pool/replicated-data-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_groups} ----------------------------------------------------------------- time: 00:02:59 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454282/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454282/ sentry: https://sentry.ceph.com/organizations/ceph/?query=642459675b6b4b76a84b8243817c03c2 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1 =7860f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454284] rbd/singleton/{all/read-flags-writeback objectstore/filestore-xfs openstack supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:04:58 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454284/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454284/ sentry: https://sentry.ceph.com/organizations/ceph/?query=569285af76324e9d9395838ff01583dd Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454286] rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-hybrid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} ----------------------------------------------------------------- time: 00:04:07 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454286/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454286/ sentry: https://sentry.ceph.com/organizations/ceph/?query=349285d025a9496ba50a281cbcc1dc89 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 [6454288] rbd/immutable-object-cache/{clusters/{fix-2 openstack} pool/ceph_and_immutable_object_cache supported-random-distro$/{centos_8} workloads/qemu_on_immutable_object_cache_and_thrash} ----------------------------------------------------------------- time: 00:04:06 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454288/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454288/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58f8dfbab0aa4ac8af72f5a06f2d42af Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=786 0f3d77ee3e58c18067dbf7c5e3242c90d9096 Dead ================================================================= [6454102] rbd/singleton/{all/rbdmap_RBDMAPFILE objectstore/bluestore-stupid openstack supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454102/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454102/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d786c18dfa184e1a945441b58602b4a7 Failed to power on gibba027 [6454104] rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_fsx_deep_copy} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454104/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-21_06:00:03-rbd-octopus-distro-default-gibba/6454104/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48b7383a0b7f4b45b8d0336d61613a31 reached maximum tries (60) after waiting for 900 seconds