2023-10-29T20:02:35.090 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-29T20:02:35.091 INFO:teuthology.results:subset: '50/99' 2023-10-29T20:02:35.091 INFO:teuthology.results:seed: '2460' 2023-10-29T20:14:22.346 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-10-29T20:14:22.350 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-10-29T21:50:29.761 INFO:teuthology.results:Tests finished! gathering results... 2023-10-29T21:50:30.008 INFO:scrape:Found 5 jobs 2023-10-29T21:50:31.330 INFO:scrape:Found 2 distinct failure reasons 2023-10-29T21:50:31.331 INFO:scrape:Failure: "2023-10-29T20:28:53.779434+0000 mon.a (mon.0) 190 : cluster [WRN] Health check failed: Degraded data redundancy: 1/334 objects degraded (0.299%), 1 pg degraded (PG_DEGRADED)" in cluster log 2023-10-29T21:50:31.331 INFO:scrape:1 jobs: ['7440957'] 2023-10-29T21:50:31.332 INFO:scrape:suites: ['clients/mirror', 'cluster/{2-node', 'conf/{disable-pool-app}', 'msgr-failures/few', 'objectstore/bluestore-hybrid', 'openstack}', 'policy/simple', 'rbd-mirror/four-per-cluster', 'rbd/mirror-thrash/{base/install', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rbd-mirror-snapshot-stress-workunit-minimum}'] 2023-10-29T21:50:31.332 INFO:scrape: 2023-10-29T21:50:31.332 INFO:scrape:Failure: Command failed on smithi167 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' 2023-10-29T21:50:31.333 INFO:scrape:2 jobs: ['7440959', '7440958'] 2023-10-29T21:50:31.333 INFO:scrape:suites intersection: ['2-cluster/{fix-2', '3-supported-random-distro$/{ubuntu_latest}', '4-cache-path', '7-workloads/qemu_xfstests', 'conf/{disable-pool-app}}', 'openstack}', 'rbd/pwl-cache/tmpfs/{1-base/install'] 2023-10-29T21:50:31.334 INFO:scrape:suites union: ['2-cluster/{fix-2', '3-supported-random-distro$/{ubuntu_latest}', '4-cache-path', '5-cache-mode/rwl', '5-cache-mode/ssd', '6-cache-size/1G', '6-cache-size/5G', '7-workloads/qemu_xfstests', 'conf/{disable-pool-app}}', 'openstack}', 'rbd/pwl-cache/tmpfs/{1-base/install'] 2023-10-29T21:50:31.334 INFO:scrape: 2023-10-29T21:50:31.335 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 2 Fail ================================================================= [7440957] rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{ubuntu_latest} workloads/rbd-mirror-snapshot-stress-workunit-minimum} ----------------------------------------------------------------- time: 00:52:25 info: http://pulpito.ceph.com/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/7440957/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/7440957/ "2023-10-29T20:28:53.779434+0000 mon.a (mon.0) 190 : cluster [WRN] Health check failed: Degraded data redundancy: 1/334 objects degraded (0.299%), 1 pg degraded (PG_DEGRADED)" in cluster log [7440958] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/rwl 6-cache-size/1G 7-workloads/qemu_xfstests conf/{disable-pool-app}} ----------------------------------------------------------------- time: 01:27:12 info: http://pulpito.ceph.com/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/7440958/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/7440958/ Command failed on smithi152 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' [7440959] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/ssd 6-cache-size/5G 7-workloads/qemu_xfstests conf/{disable-pool-app}} ----------------------------------------------------------------- time: 01:25:41 info: http://pulpito.ceph.com/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/7440959/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/7440959/ Command failed on smithi167 with status 1: 'test -f /home/ubuntu/cephtest/archive/qemu/client.0/success' Pass ================================================================= [7440956] rbd/pwl-cache/tmpfs/{1-base/install 2-cluster/{fix-2 openstack} 3-supported-random-distro$/{ubuntu_latest} 4-cache-path 5-cache-mode/rwl 6-cache-size/5G 7-workloads/qemu_xfstests conf/{disable-pool-app}} time: 01:35:38 info: http://pulpito.ceph.com/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/7440956/ [7440960] rbd/librbd/{cache/none clusters/{fixed-3 openstack} conf/{disable-pool-app} data-pool/replicated extra-conf/permit-partial-discard min-compat-client/octopus msgr-failures/few objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_latest} workloads/c_api_tests} time: 00:43:28 info: http://pulpito.ceph.com/dis-2023-10-29_19:55:02-rbd-wip-dis-testing-distro-default-smithi/7440960/