2023-09-03T10:07:24.803 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-03T10:07:24.804 INFO:teuthology.results:subset: '1/1000'
2023-09-03T10:07:24.804 INFO:teuthology.results:seed: '1239'
2023-09-03T10:08:14.343 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556
2023-09-03T10:08:14.348 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-09-03T22:09:06.840 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2023-09-03T22:09:09.032 INFO:scrape:Found 25 jobs
2023-09-03T22:09:09.292 INFO:scrape:Found 7 distinct failure reasons
2023-09-03T22:09:09.293 INFO:scrape:Failure: Host key for server 'smithi016.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAINXB1It+52lrkPp3gfkJ5/0cI1dPxaGtnBhwaHD6MIoO', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC72+m0j1RbUspKDpcssa2o24N+zQjOWGSu7IG2eF6YRprzeXMYCy772WpHAuMl7n0IQ7AaO1O4hF5K7qRZwcmntH4+Y4qMJ4EOq+0e/yVwDqAFuz5WM/zZV+qHsQI5r+uQBhxz7ppElOsdzLAEgcduk/GeJLnYmzbBYeuafOhgsJNjtV+yjg/889iIAGrnXH37TgZ9TJKhhZ8wlRdKxBLOvgecCmDWKfbn5QN0SuaCdOJD7AiNyGj4Mu9raWYrbGTTUdhGecuk2PRnaC+KjS/wAiJjdPIJr4CLvOwmrhcvAS/wd++sETzus2Kbz4sM7cAagKmIJj/2wkUuLDF09zVwCgzmUejbO1kZo7DjFof5ZhFrPygv6taDDDpbbbV23hEaT1W90ebwkijQVA5EH+hCFCHfr6dcu8bc0YbXmfFv5Is6qd5Gc/H7Z/uUDHJOClXprmFIKZ3S2tYps8gxm4Z/FfIEOpCXCc0bqwicrcAXuZdwNU45rCP6WTepwr2IgJM='
2023-09-03T22:09:09.293 INFO:scrape:1 jobs: ['7387505']
2023-09-03T22:09:09.293 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/none', 'thrashosds-health', 'workloads/redirect_promote_tests}']
2023-09-03T22:09:09.294 INFO:scrape:
2023-09-03T22:09:09.294 INFO:scrape:Dead: b'2023-09-03T22:09:09.046 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops'
2023-09-03T22:09:09.295 INFO:scrape:2 jobs: ['7387500', '7387508']
2023-09-03T22:09:09.295 INFO:scrape:suites intersection: ['1-pg-log-overrides/short_pg_log', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/fastclose', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size', 'thrashosds-health']
2023-09-03T22:09:09.296 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_latest}', 'thrashers/default', 'thrashers/pggrow', 'thrashosds-health', 'workloads/pool-snaps-few-objects}', 'workloads/small-objects-balanced}']
2023-09-03T22:09:09.296 INFO:scrape:
2023-09-03T22:09:09.296 INFO:scrape:Failure: Host key for server 'smithi033.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIKVD25ZDbSDsfOJMMwzUYBzHC+aw0BP44ntJmfMFAStJ', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQCi+NFa0FUTB8iSPPQoR71G8PjSFIXBqeDttP9rqDwXdFgp97yJ2u7+lH4jfdvPEAezdQTI/hRFcOOamhFXUVVEMxpwA1N1vrmhf8rCdUmLibQG2N/1uGlxqFbyUzqV8lCJBUQ6UKhZ7ENLDBW8G9wiO1zZ7CunWuEDs4463pmtjoUIVPulr9vm8NCAKPxCL4rVZyPHitWeuTv3B27kaflONSNscCwEdKTEscvGtoTF9/ej4hwE1Sj/GzcW4YCWvb7pvm3S1OasiBNUqY1usdHnmJJ5JQBijsBT1grlsEqxJkqpRzCKAwydR6RQ2muRVEyjBjl88jNw/mrPQykQUIJAHjA6Fe4gt1xvuSNFLDxnkgdzR8O/hJCzjwmolL/ItDHjuwHMLTxaz9eGOzskJyxVI4GH+YH4f7fteI+/c2XenP2wzzmPlrsYSQGSEKj6pmbi0VxdnKc+Dz2fDdEbEivEdZlhBfQoySiIwVugSWo2kJb5t27bORWZf25OahoJHiU='
2023-09-03T22:09:09.297 INFO:scrape:1 jobs: ['7387513']
2023-09-03T22:09:09.297 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/snaps-few-objects}']
2023-09-03T22:09:09.298 INFO:scrape:
2023-09-03T22:09:09.298 INFO:scrape:Failure: Host key for server 'smithi044.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIH9beunrafO0Ysgmze3G2zFg1TBLL5apzXfqBxDzjjEe', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC/4J84pO4SwStYy0Zc2t1ZBBHO9mO5tqv5jZYWuXt6mVLnOtzTI2k6UAKHReQTLPx/htKk4z4Wo8OdKN5mOfrt24efRljaeHJt+pFE/Naw1lMNbKN4sooG6fOwZXxSpQCZxahtD3I5NIRJ0zs/nQvehgpSrSq+GDt3Tr/h8ic/C63+dNxwZ+tn8JKPSagA1dSgFa+943q/Er9mBBOnPrYo3OrYm4vz6N0hn6UHOBOq3jJmJFpLL8l7g98f4ht+1RqEi1mdK/mDqtDEVMi50CG/g6vDv7t1nvozT0pZHx8z2WmlLDzKXq8xqGtGSqB5onb6p5cNraICo3d0ADQ20xLTDoSn+nEFcdlt/tY/k6c/eF3Xe19mhDbvdT5h/Ef/2cnsgvgm1Z8T0xqodS4Ji2UNJOSSh04M1GnAq8QmMtUE5SuAXw9I1vbT4CD94rKcJm1QdFGieOAmolAsIfLv8mZkJsdqX3Lv7hhQfjlCtMcFccCOR/gOElA88bD/LkC9hIk='
2023-09-03T22:09:09.299 INFO:scrape:1 jobs: ['7387512']
2023-09-03T22:09:09.299 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr/async', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/snaps-few-objects-localized}']
2023-09-03T22:09:09.299 INFO:scrape:
2023-09-03T22:09:09.300 INFO:scrape:Failure: Host key for server 'smithi125.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIIfAlyoqglzf6qYNQ07uEVd7QXoI35DOy6QzbhWDyOEb', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQDgqGVccgCTplyzdFlwoU2Dbj1hJKJT2APl6PfZ0S9yiQ9cIAriE5ns3o0khmWKsF5rDubXUVVybTFl/eMx9nLqZXmPww1VfmpBa6oVqyG1uqg7QsLT5ZtMh6OsD3bqZGUAgWq+KOgDfVvia3mWD+WDeVGpr1H2QR+TI/hem6Ef2EHZlmYGkl5XLJ1V81cwykew37WiTYwD1WGmsqLNGofgkJoQAgMtCuv8PBeEx/5LKAlr8eESCMb0LKv1wMbudOkRjhMoaI9Kthvi2H8z8yZLo5KLBlctKkI2Juel8o0fDtaLFK53RTvJWLT87URsQO4yeh50lpRLk2UOjFTu0CI8MtHpO5Pv92LB0Wx24PpXonQnmiI/pI80i6XlAFvMtFXLc/G8BWV8VLbAlTj9KDQDTSsZnRXmoni7NmNdI5/2E/xQuCxngNXg39HNodGsDJyC/yOThAfx6now0EbbOjf1ZLLBZ6RzFId1OM4zUYpCaLl8vYRBJlZ/iS/+Pku6Nxc='
2023-09-03T22:09:09.300 INFO:scrape:1 jobs: ['7387503']
2023-09-03T22:09:09.301 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/radosbench}']
2023-09-03T22:09:09.301 INFO:scrape:
2023-09-03T22:09:09.301 INFO:scrape:Failure: Host key for server 'smithi164.front.sepia.ceph.com' does not match: got 'AAAAC3NzaC1lZDI1NTE5AAAAIIPeK/javgwvbTdYzVZDiUAlvAZEhd/LtNSwmnPs1+zn', expected 'AAAAB3NzaC1yc2EAAAADAQABAAABgQC7P8Aj6K/VA6rfLl7JWKZGTRCU8e+jYOMdwunlE2tHfKubjKPS1zurXqBsaz9tgLYiFgQ1WDwcee4sKePMcGJsB0aWeTgL6gwoJZhdRyvOu/TSFCRk7jK0N23ffT49vfi+E92I1o0QonFSZtXwpXnWEfNe4+EWKZez9p//V+TQ0oxJOzaQRY/zOnmdgeakuWLKC9Zp4PjO8s/XTHN+1oc/7WiR8RdwJIySKH5V6Xy2Of1+hslQgEBIQJi7/wTpADQr6jVLwWvzj6Ks1D1WrapBHVnS3l7Qb8wLM7sZBiviwcXtlJX6bNNWgVD3F5v9n6Wuo4XW1Gy400+zK9oGdhpfhQ4t3wOPiJ4ZeARnNFUcBfo0GF/OBrwbuPRFVwPvbCSi2bm12ecGk/OIlxlJtjms52yEktvCov+Rwry+xZOh+KrGr83O8MaKDPRcPRPAUN0Y7J2sTl+17SihYGJfL1Uv3rtaJXGrAcfS+33JQnKmtL0IDs8x7LnF1XiaA7OWUQU='
2023-09-03T22:09:09.302 INFO:scrape:1 jobs: ['7387517']
2023-09-03T22:09:09.302 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{default}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/none', 'thrashosds-health', 'workloads/cache-agent-small}']
2023-09-03T22:09:09.303 INFO:scrape:
2023-09-03T22:09:09.303 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json
2023-09-03T22:09:09.304 INFO:scrape:1 jobs: ['7387510']
2023-09-03T22:09:09.304 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_latest}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/small-objects}']
2023-09-03T22:09:09.304 INFO:scrape: