2023-06-18T15:37:50.937 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-18T15:37:50.938 INFO:teuthology.results:seed: '3308'
2023-06-18T15:38:02.521 INFO:root:teuthology version: 0.0.1.dev128+g076bbeb
2023-06-18T15:38:02.522 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2023-06-18T15:57:04.057 INFO:teuthology.results:Tests finished! gathering results...
2023-06-18T15:57:04.158 INFO:scrape:Found 20 jobs
2023-06-18T15:57:04.159 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307047/teuthology.log
2023-06-18T15:57:04.183 INFO:scrape:Found 2 distinct failure reasons
2023-06-18T15:57:04.184 INFO:scrape:Dead: None
2023-06-18T15:57:04.185 INFO:scrape:19 jobs: ['7307047', '7307042', '7307043', '7307050', '7307040', '7307045', '7307046', '7307037', '7307038', '7307053', '7307039', '7307051', '7307048', '7307036', '7307044', '7307049', '7307054', '7307052', '7307041']
2023-06-18T15:57:04.185 INFO:scrape:
2023-06-18T15:57:04.186 INFO:scrape:Failure: SSH connection to smithi134 was lost: 'sudo dpkg -i /tmp/linux-image.deb'
2023-06-18T15:57:04.186 INFO:scrape:1 jobs: ['7307035']
2023-06-18T15:57:04.187 INFO:scrape:suites: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'krbd/thrash/{bluestore-bitmap', 'ms_mode$/{legacy}', 'thrashers/backoff', 'thrashosds-health', 'workloads/krbd_diff_continuous}']
2023-06-18T15:57:04.188 INFO:scrape:
2023-06-18T15:57:04.189 INFO:teuthology.results:Sending results to idryomov@gmail.com: Test Run: dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi
=================================================================
info:    http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/
failed:  0
dead:    20
running: 0
waiting: 0
queued:  0
passed:  0


Dead
=================================================================
[7307035]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307035/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307035/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dea0f1a8dcff4c43a56360f8e7adc8db

    SSH connection to smithi134 was lost: 'sudo dpkg -i /tmp/linux-image.deb'

[7307036]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307036/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307036/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307037]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307037/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307037/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307038]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307038/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307038/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307039]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/backoff thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307039/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307039/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307040]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307040/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307040/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307041]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307041/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307041/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307042]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307042/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307042/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307043]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307043/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307043/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307044]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy-rxbounce} thrashers/upmap thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307044/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307044/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307045]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307045/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307045/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307046]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307046/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307046/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307047]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307047/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307047/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307048]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307048/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307048/

    Error reimaging machines: 500 Server Error: Internal Server Error for url:
    http://fog.front.sepia.ceph.com/fog/host/189/task

[7307049]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/pggrow thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307049/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307049/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307050]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307050/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307050/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307051]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307051/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307051/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307052]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307052/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307052/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307053]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307053/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307053/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds

[7307054]  krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf ms_mode$/{legacy} thrashers/mon-thrasher thrashosds-health workloads/krbd_diff_continuous}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307054/
log:    http://qa-proxy.ceph.com/teuthology/dis-2023-06-18_15:37:31-krbd-main-wip-exclusive-lock-snapc-default-smithi/7307054/

    Error reimaging machines: reached maximum tries (101) after waiting for 600
    seconds