2023-06-18T15:40:25.877 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-18T15:40:25.878 INFO:teuthology.results:seed: '3308' 2023-06-18T15:40:35.294 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb 2023-06-18T15:40:35.295 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-18T17:32:44.138 INFO:teuthology.results:Tests finished! gathering results... 2023-06-18T17:32:45.020 INFO:scrape:Found 20 jobs 2023-06-18T17:32:45.064 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307069/teuthology.log 2023-06-18T17:32:45.065 INFO:scrape:Found 2 distinct failure reasons 2023-06-18T17:32:45.065 INFO:scrape:Failure: SSH connection to smithi155 was lost: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main' 2023-06-18T17:32:45.065 INFO:scrape:1 jobs: ['7307057'] 2023-06-18T17:32:45.066 INFO:scrape:suites: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'krbd/thrash/{bluestore-bitmap', 'ms_mode$/{legacy}', 'thrashers/backoff', 'thrashosds-health', 'workloads/krbd_diff_continuous}'] 2023-06-18T17:32:45.066 INFO:scrape: 2023-06-18T17:32:45.066 INFO:scrape:Dead: None 2023-06-18T17:32:45.066 INFO:scrape:1 jobs: ['7307069'] 2023-06-18T17:32:45.067 INFO:scrape: 2023-06-18T17:32:45.068 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi ================================================================= info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/ failed: 0 dead: 2 running: 0 waiting: 0 queued: 0 passed: 18 Dead ================================================================= [7307057] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307057/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307057/ sentry: https://sentry.ceph.com/organizations/ceph/?query=02bfbae8bb9e4d488f114de5fc76dc1f SSH connection to smithi155 was lost: 'cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main' [7307069] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307069/ log: http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307069/ Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/204/task Pass ================================================================= [7307058] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} time: 01:04:52 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307058/ [7307059] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} time: 01:05:00 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307059/ [7307060] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} time: 01:24:51 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307060/ [7307061] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous} time: 01:19:08 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307061/ [7307062] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} time: 01:21:51 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307062/ [7307063] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} time: 01:12:55 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307063/ [7307064] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} time: 01:20:18 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307064/ [7307065] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} time: 01:07:44 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307065/ [7307066] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous} time: 01:19:51 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307066/ [7307067] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} time: 01:23:36 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307067/ [7307068] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} time: 01:16:05 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307068/ [7307070] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} time: 01:08:50 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307070/ [7307071] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous} time: 01:14:50 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307071/ [7307072] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} time: 01:06:36 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307072/ [7307073] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} time: 01:06:38 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307073/ [7307074] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} time: 01:20:56 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307074/ [7307075] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} time: 01:09:09 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307075/ [7307076] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous} time: 01:15:06 info: http://pulpito.ceph.com/dis-2023-06-18_15:40:00-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307076/