2020-04-27T02:26:10.986 INFO:root:teuthology version: 1.0.0-6cf40593
2020-04-27T02:26:10.989 INFO:teuthology.results:seed: '8745'
2020-04-27T02:40:22.057 INFO:root:teuthology version: 1.0.0-6cf40593
2020-04-27T02:40:22.092 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-04-27T14:40:34.126 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2020-04-27T14:40:34.211 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/
failed:  30
dead:    1
running: 0
waiting: 1
queued:  0
passed:  0


Fail
=================================================================
[4987773]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml}
-----------------------------------------------------------------
time:   00:40:19
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987773/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987773/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=3096fa8d164542c8b4961b4f3cd2f995

    "2020-04-27 03:03:06.265327 mon.a mon.0 172.21.15.129:6789/0 271 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987774]  upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:38:34
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987774/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987774/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=45823d5a5d044a3d8a7dc008adfbb06a

    'pg_num_target'

[4987775]  upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:31:46
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987775/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987775/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=8144a7ebb8994777ac05f2249c73d1f0

    'pg_num_target'

[4987776]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:24:48
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987776/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987776/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=954052787c764f4bb0e63cd83e3f4936

    "2020-04-27 02:50:00.589922 mon.c mon.0 172.21.15.1:6789/0 147 : cluster
    [WRN] Health check failed: too few PGs per OSD (2 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987777]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml}
-----------------------------------------------------------------
time:   00:28:39
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987777/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987777/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=1ca95d4b0aea45fe813c42ed154fcba6

    "2020-04-27 03:32:09.995904 mon.c mon.0 172.21.15.75:6789/0 125 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987778]  upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:25:11
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987778/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987778/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=cd8a93f2e3c8486cac72ff6753a52219

    'pg_num_target'

[4987779]  upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:25:00
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987779/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987779/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=cebaf295013c4b6e9d27b3f51cd0b19a

    'pg_num_target'

[4987780]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:25:11
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987780/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987780/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=846cc899a1cd4902874d6a5ab9a0c6b3

    "2020-04-27 03:28:38.244381 mon.b mon.0 172.21.15.23:6789/0 136 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987781]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml}
-----------------------------------------------------------------
time:   00:29:20
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987781/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987781/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=44fead02cd46472da1d333bd45294f84

    "2020-04-27 03:59:45.878750 mon.c mon.0 172.21.15.8:6789/0 135 : cluster
    [WRN] Health check failed: too few PGs per OSD (2 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987782]  upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:29:03
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987782/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987782/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=51b143be6b0f46d4b56501c00b64a091

    'pg_num_target'

[4987783]  upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:28:58
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987783/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987783/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=dc1d6abfbbe54ea0be546f4f132d16ef

    'pg_num_target'

[4987784]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:24:50
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987784/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987784/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=65cccb2dfaf341b9864c32ca362563ff

    "2020-04-27 02:51:27.819878 mon.c mon.0 172.21.15.16:6789/0 140 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987785]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml}
-----------------------------------------------------------------
time:   00:28:46
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987785/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987785/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=a5393c6c16ec431dadc3cb3fde4eae1e

    "2020-04-27 03:18:09.962384 mon.c mon.0 172.21.15.31:6789/0 131 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987786]  upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:25:18
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987786/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987786/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=6e4feefb47dc41f0a56b4200499e477b

    'pg_num_target'

[4987787]  upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:25:27
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987787/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987787/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=9e9a95c21d5c4d4d97a5166b407eb77a

    'pg_num_target'

[4987788]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:25:20
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987788/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987788/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=56c39b8eddfa406cb1ef544530cf7689

    "2020-04-27 02:47:30.788690 mon.c mon.0 172.21.15.55:6789/0 130 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987789]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml}
-----------------------------------------------------------------
time:   00:29:19
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987789/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987789/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=8a89ccb7a279476cb992188c5391717f

    "2020-04-27 04:35:46.520740 mon.b mon.0 172.21.15.70:6789/0 282 : cluster
    [WRN] Health check failed: too few PGs per OSD (2 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987790]  upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:29:23
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987790/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987790/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=c2f432ee2b814aea92191983348deaaa

    'pg_num_target'

[4987792]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:24:35
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987792/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987792/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=e0b6dfe417814a0f9dfbcc30cf671f2f

    "2020-04-27 03:14:13.453973 mon.c mon.0 172.21.15.83:6789/0 140 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987793]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml}
-----------------------------------------------------------------
time:   00:28:56
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987793/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987793/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=072c72e1266e44e9b6d7a0c2168f98ed

    "2020-04-27 03:52:49.274764 mon.a mon.0 172.21.15.92:6789/0 131 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987794]  upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:24:56
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987794/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987794/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=2c4a45d1d1944e428bb06793c3171d87

    'pg_num_target'

[4987795]  upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:24:55
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987795/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987795/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=90256e711fd14773999f84414f7f4ea5

    'pg_num_target'

[4987796]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:25:46
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987796/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987796/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=4ee919c36ad743febf80b9f30b28521d

    "2020-04-27 03:49:53.490238 mon.c mon.0 172.21.15.31:6789/0 132 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987797]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml}
-----------------------------------------------------------------
time:   00:31:54
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987797/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987797/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=3c8a09b0581b4e3bbcdb08c2221eff7a

    "2020-04-27 04:09:06.189746 mon.a mon.0 172.21.15.19:6789/0 141 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987798]  upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:28:57
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987798/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987798/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=5a0a133359884b0d922f6fe04ee34dac

    'pg_num_target'

[4987800]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:24:33
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987800/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987800/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=52eefbb3fd8b495490a0ef5071545edc

    "2020-04-27 03:09:41.325116 mon.b mon.0 172.21.15.92:6789/0 132 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987801]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml}
-----------------------------------------------------------------
time:   00:33:19
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987801/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987801/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b469a961efbc44599e9e5b4379bb50f2

    "2020-04-27 03:09:28.287806 mon.c mon.0 172.21.15.58:6789/0 261 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log

[4987802]  upgrade:luminous-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:25:18
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987802/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987802/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=7b5bb780dfb1455db8e1dfc5db8438ec

    'pg_num_target'

[4987803]  upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:25:25
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987803/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987803/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=b377196f9cca454b9c571535de653dde

    'pg_num_target'

[4987804]  upgrade:luminous-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/luminous.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml}
-----------------------------------------------------------------
time:   00:25:02
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987804/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987804/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=007b4c12964c4380be2f92a8c479d724

    "2020-04-27 05:24:07.242830 mon.c mon.0 172.21.15.150:6789/0 131 : cluster
    [WRN] Health check failed: too few PGs per OSD (1 < min 30) (TOO_FEW_PGS)"
    in cluster log



Dead
=================================================================
[4987791]  upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987791/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987791/



Waiting
=================================================================
[4987799] upgrade:luminous-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/luminous.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml}
info:   http://pulpito.ceph.com/teuthology-2020-04-27_02:25:03-upgrade:luminous-x-nautilus-distro-basic-smithi/4987799/
2020-04-27T14:40:34.347 INFO:teuthology.results:starting coverage generation
2020-04-27T14:40:34.351 ERROR:teuthology.results:error generating memo/results
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main
    int(args['--timeout']), args['--dry-run'])
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results
    generate_coverage(archive_dir, name)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage
    archive_dir,
  File "/usr/lib/python3.6/subprocess.py", line 729, in __init__
    restore_signals, start_new_session)
  File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'