2022-06-29T21:09:19.947 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-06-29T21:09:19.948 INFO:teuthology.results:seed: '1671'
2022-06-29T21:17:03.463 INFO:root:teuthology version: 1.1.1.dev379+gf58709e3
2022-06-29T21:17:03.467 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-06-29T21:38:04.941 INFO:teuthology.results:Tests finished! gathering results...
2022-06-29T21:38:05.195 INFO:scrape:Found 4 jobs
2022-06-29T21:38:05.208 INFO:scrape:Found 1 distinct failure reasons
2022-06-29T21:38:05.208 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json
2022-06-29T21:38:05.208 INFO:scrape:4 jobs: ['6906455', '6906453', '6906456', '6906454']
2022-06-29T21:38:05.209 INFO:scrape:suites intersection: ['1-ceph-install/quincy', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '6-final-workload/{rbd-python', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:quincy-p2p:quincy-p2p-stress-split/{0-cluster/{openstack']
2022-06-29T21:38:05.209 INFO:scrape:suites union: ['1-ceph-install/quincy', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '6-final-workload/{rbd-python', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:quincy-p2p:quincy-p2p-stress-split/{0-cluster/{openstack']
2022-06-29T21:38:05.210 INFO:scrape:
2022-06-29T21:38:05.211 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/
failed:  4
dead:    0
running: 0
waiting: 0
queued:  0
passed:  0


Fail
=================================================================
[6906453]  upgrade:quincy-p2p:quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health}
-----------------------------------------------------------------
time:   00:11:26
info:   http://pulpito.ceph.com/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/6906453/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/6906453/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0000c5b0b1f24e238bcb2b63a4719483

    Command failed on smithi033 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph pg dump --format=json'

[6906454]  upgrade:quincy-p2p:quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-comp supported-all-distro/ubuntu_latest thrashosds-health}
-----------------------------------------------------------------
time:   00:11:18
info:   http://pulpito.ceph.com/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/6906454/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/6906454/
sentry: https://sentry.ceph.com/organizations/ceph/?query=20314534f5fc4537bec7ac7d8ae39b71

    Command failed on smithi137 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph pg dump --format=json'

[6906455]  upgrade:quincy-p2p:quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health}
-----------------------------------------------------------------
time:   00:11:18
info:   http://pulpito.ceph.com/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/6906455/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/6906455/
sentry: https://sentry.ceph.com/organizations/ceph/?query=55dfcaf3565e400e8921e6a400841162

    Command failed on smithi143 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph pg dump --format=json'

[6906456]  upgrade:quincy-p2p:quincy-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/quincy 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health}
-----------------------------------------------------------------
time:   00:10:51
info:   http://pulpito.ceph.com/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/6906456/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-06-29_20:50:58-upgrade:quincy-p2p:quincy-p2p-stress-split-quincy-distro-default-smithi/6906456/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b9bf37c7b10648e8928093361e9aeba2

    Command failed on smithi104 with status 124: 'sudo adjust-ulimits ceph-
    coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster
    ceph pg dump --format=json'