2023-11-02T09:09:08.267 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-02T09:09:08.268 INFO:teuthology.results:subset: '111/120000' 2023-11-02T09:09:08.269 INFO:teuthology.results:seed: '9009' 2023-11-02T09:17:52.079 INFO:root:teuthology version: 0.0.1.dev203+g6899cd2 2023-11-02T09:17:52.116 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-11-02T21:18:49.158 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2023-11-02T21:18:50.737 INFO:scrape:Found 20 jobs 2023-11-02T21:18:50.764 INFO:scrape:Found 3 distinct failure reasons 2023-11-02T21:18:50.765 INFO:scrape:Dead: b'OSError: Socket is closed' 2023-11-02T21:18:50.765 INFO:scrape:1 jobs: ['7444161'] 2023-11-02T21:18:50.765 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/snaps-few-objects}'] 2023-11-02T21:18:50.766 INFO:scrape: 2023-11-02T21:18:50.766 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0' 2023-11-02T21:18:50.767 INFO:scrape:16 jobs: ['7444145', '7444157', '7444149', '7444162', '7444153', '7444160', '7444146', '7444158', '7444152', '7444156', '7444163', '7444164', '7444151', '7444150', '7444148', '7444155'] 2023-11-02T21:18:50.767 INFO:scrape:suites intersection: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/snaps-few-objects}'] 2023-11-02T21:18:50.768 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/snaps-few-objects}'] 2023-11-02T21:18:50.768 INFO:scrape: 2023-11-02T21:18:50.769 INFO:scrape:Dead: b'2023-11-02T21:18:44.137 DEBUG:teuthology.exit:Finished running handlers' 2023-11-02T21:18:50.769 INFO:scrape:1 jobs: ['7444154'] 2023-11-02T21:18:50.769 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/snaps-few-objects}'] 2023-11-02T21:18:50.770 INFO:scrape: