2020-06-17T14:29:59.766 INFO:root:teuthology version: 1.0.0-850e85f 2020-06-17T14:29:59.768 INFO:teuthology.results:seed: '8885' 2020-06-17T14:33:49.667 INFO:root:teuthology version: 1.0.0-850e85f 2020-06-17T14:33:49.686 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-06-17T22:38:01.090 INFO:teuthology.results:Tests finished! gathering results... 2020-06-17T22:38:01.157 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 14 Fail ================================================================= [5157801] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 02:37:10 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157801/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157801/ "2020-06-17T15:02:12.957212+0000 mds.a (mds.0) 5 : cluster [WRN] evicting unresponsive client smithi150: (4865), after waiting 47.9752 seconds during MDS startup" in cluster log [5157808] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 02:34:18 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157808/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157808/ "2020-06-17T15:03:48.310388+0000 mds.a (mds.0) 5 : cluster [WRN] evicting unresponsive client smithi143: (34319), after waiting 48.8543 seconds during MDS startup" in cluster log Pass ================================================================= [5157797] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:37:49 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157797/ [5157798] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 03:59:10 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157798/ [5157799] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} time: 02:20:44 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157799/ [5157800] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 02:32:02 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157800/ [5157802] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:26:52 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157802/ [5157803] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} time: 01:43:50 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157803/ [5157804] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 02:30:57 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157804/ [5157805] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:34:13 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157805/ [5157806] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 04:10:08 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157806/ [5157807] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} time: 02:04:23 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157807/ [5157809] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:37:01 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157809/ [5157810] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:24:44 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157810/ [5157811] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} time: 01:59:10 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157811/ [5157812] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 02:30:15 info: http://pulpito.ceph.com/teuthology-2020-06-17_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5157812/