2024-02-14T16:38:35.074 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-02-14T16:38:35.074 INFO:teuthology.results:subset: '11/211' 2024-02-14T16:38:35.075 INFO:teuthology.results:seed: '1425' 2024-02-14T16:38:42.451 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-02-14T16:38:42.451 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-02-14T18:33:51.430 INFO:teuthology.results:Tests finished! gathering results... 2024-02-14T18:33:52.845 INFO:scrape:Found 20 jobs 2024-02-14T18:33:52.846 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559692/teuthology.log 2024-02-14T18:33:52.846 INFO:scrape:Found 1 distinct failure reasons 2024-02-14T18:33:52.847 INFO:scrape:Dead: None 2024-02-14T18:33:52.847 INFO:scrape:2 jobs: ['7559692', '7559693'] 2024-02-14T18:33:52.847 INFO:scrape: 2024-02-14T18:33:52.847 INFO:teuthology.results:Sending results to akupczyk@redhat.com: Test Run: akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/ failed: 0 dead: 2 running: 0 waiting: 0 queued: 0 passed: 18 Dead ================================================================= [7559692] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559692/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559692/ Error reimaging machines: Expected smithi157's OS to be ubuntu 22.04 but found centos 9 [7559693] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559693/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559693/ Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/262/task Pass ================================================================= [7559676] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:32:23 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559676/ [7559677] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:28 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559677/ [7559678] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:29:14 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559678/ [7559679] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:31 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559679/ [7559680] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:13 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559680/ [7559681] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 00:44:16 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559681/ [7559682] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:25:47 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559682/ [7559683] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:25:27 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559683/ [7559684] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:09 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559684/ [7559685] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:03 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559685/ [7559686] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:28 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559686/ [7559687] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:23 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559687/ [7559688] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:57 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559688/ [7559689] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:41:44 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559689/ [7559690] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:23:07 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559690/ [7559691] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:36 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559691/ [7559694] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:02 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559694/ [7559695] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:28 info: https://pulpito.ceph.com/akupczyk-2024-02-14_08:19:56-rados-wip-pereman2-buffer-space-distro-default-smithi/7559695/