2022-06-19T11:35:29.024 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0 2022-06-19T11:35:29.034 INFO:teuthology.results:subset: '1/4' 2022-06-19T11:35:29.035 INFO:teuthology.results:seed: '4184' 2022-06-19T11:53:59.088 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0 2022-06-19T11:53:59.110 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-19T12:21:02.537 INFO:teuthology.results:Tests finished! gathering results... 2022-06-19T12:21:21.583 INFO:scrape:Found 38 jobs 2022-06-19T12:21:27.807 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/rfriedma-2022-06-19_11:28:45-rados::thrash-wip-rf-pg-updates-distro-default-smithi/6886733/teuthology.log 2022-06-19T12:21:28.698 INFO:scrape:Found 4 distinct failure reasons 2022-06-19T12:21:28.724 INFO:scrape:Failure: No module named 'tasks.ceph' 2022-06-19T12:21:28.725 INFO:scrape:10 jobs: ['6886750', '6886747', '6886752', '6886749', '6886748', '6886755', '6886751', '6886753', '6886754', '6886757'] 2022-06-19T12:21:28.726 INFO:scrape:suites intersection: ['1-pg-log-overrides/short_pg_log', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'openstack}', 'rados', 'rados::thrash/{0-size-min-size-overrides/2-size-2-min-size', 'thrashosds-health'] 2022-06-19T12:21:28.746 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados::thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'workloads/cache-snaps-balanced}', 'workloads/cache-snaps}'] 2022-06-19T12:21:28.747 INFO:scrape: 2022-06-19T12:21:28.779 INFO:scrape:Failure: Command failed on smithi093 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-12912-ga3b18805-1focal ceph-mds=17.0.0-12912-ga3b18805-1focal ceph-common=17.0.0-12912-ga3b18805-1focal ceph-fuse=17.0.0-12912-ga3b18805-1focal ceph-test=17.0.0-12912-ga3b18805-1focal radosgw=17.0.0-12912-ga3b18805-1focal python-ceph=17.0.0-12912-ga3b18805-1focal libcephfs1=17.0.0-12912-ga3b18805-1focal libcephfs-java=17.0.0-12912-ga3b18805-1focal libcephfs-jni=17.0.0-12912-ga3b18805-1focal librados2=17.0.0-12912-ga3b18805-1focal librbd1=17.0.0-12912-ga3b18805-1focal rbd-fuse=17.0.0-12912-ga3b18805-1focal' 2022-06-19T12:21:28.809 INFO:scrape:6 jobs: ['6886767', '6886761', '6886756', '6886768', '6886770', '6886760'] 2022-06-19T12:21:28.811 INFO:scrape:suites intersection: ['1-pg-log-overrides/short_pg_log', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'openstack}', 'rados', 'rados::thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashosds-health'] 2022-06-19T12:21:28.812 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados::thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/mapgap', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'workloads/cache-snaps-balanced}', 'workloads/cache-snaps}'] 2022-06-19T12:21:28.813 INFO:scrape: 2022-06-19T12:21:28.824 INFO:scrape:Failure: Command failed on smithi044 with status 1: 'sudo yum -y install cephfs-java' 2022-06-19T12:21:28.825 INFO:scrape:8 jobs: ['6886764', '6886758', '6886769', '6886765', '6886766', '6886762', '6886763', '6886759'] 2022-06-19T12:21:28.829 INFO:scrape:suites intersection: ['1-pg-log-overrides/short_pg_log', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'openstack}', 'rados', 'rados::thrash/{0-size-min-size-overrides/2-size-2-min-size', 'thrashosds-health'] 2022-06-19T12:21:28.841 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados::thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'thrashers/careful', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'workloads/cache-snaps-balanced}', 'workloads/cache-snaps}'] 2022-06-19T12:21:28.842 INFO:scrape: 2022-06-19T12:21:28.843 INFO:scrape:Dead: None 2022-06-19T12:21:28.869 INFO:scrape:1 jobs: ['6886733'] 2022-06-19T12:21:28.870 INFO:scrape: