2020-01-31T20:23:09.460 INFO:root:teuthology version: 1.0.0-95fed4d 2020-01-31T20:23:09.460 INFO:teuthology.results:subset: '100/9000' 2020-01-31T20:23:09.460 INFO:teuthology.results:seed: '8591' 2020-01-31T20:33:25.735 INFO:root:teuthology version: 1.0.0-95fed4d 2020-01-31T20:33:25.740 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-01-31T22:06:27.700 INFO:teuthology.results:Tests finished! gathering results... 2020-01-31T22:06:27.759 INFO:teuthology.results:Sending results to dzafman@redhat.com: Test Run: dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/ failed: 6 dead: 9 running: 0 waiting: 0 queued: 0 passed: 1 Fail ================================================================= [4722106] upgrade:mimic-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml} ----------------------------------------------------------------- time: 00:35:02 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722106/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722106/ Command failed on smithi109 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch mimic https://github.com/dzafman/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0' [4722104] upgrade:mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722104/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722104/ psutil.NoSuchProcess process no longer exists (pid=14614) [4722110] upgrade:mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:05:54 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722110/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722110/ psutil.NoSuchProcess process no longer exists (pid=3829) [4722112] upgrade:mimic-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_16.04.yaml} ----------------------------------------------------------------- time: 00:31:25 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722112/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722112/ Command failed on smithi124 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch mimic https://github.com/dzafman/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0' [4722100] upgrade:mimic-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml} ----------------------------------------------------------------- time: 00:30:05 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722100/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722100/ Command failed on smithi152 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch mimic https://github.com/dzafman/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0' [4722109] upgrade:mimic-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.yaml} ----------------------------------------------------------------- time: 00:41:26 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722109/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722109/ Command failed on smithi075 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch mimic https://github.com/dzafman/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0' Dead ================================================================= [4722099] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722099/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722099/ [4722098] upgrade:mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722098/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722098/ [4722107] upgrade:mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722107/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722107/ [4722105] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722105/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722105/ [4722103] upgrade:mimic-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-msgr2.yaml 4-nautilus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml rgw_swift.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:25:32 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722103/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722103/ psutil.NoSuchProcess process no longer exists (pid=10349) [4722111] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/rhel_7.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722111/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722111/ [4722101] upgrade:mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722101/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722101/ [4722113] upgrade:mimic-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-msgr2.yaml 6-nautilus.yaml 7-final-workload/{rbd-python.yaml rgw-swift-ragweed_check.yaml snaps-many-objects.yaml} objectstore/bluestore-bitmap.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722113/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722113/ [4722108] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/bluestore-bitmap.yaml supported-all-distro/centos_latest.yaml thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722108/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722108/ Pass ================================================================= [4722102] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-luminous-install/mimic.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-ec-workload.yaml 5-finish-upgrade.yaml 7-final-workload.yaml objectstore/filestore-xfs.yaml supported-all-distro/ubuntu_16.04.yaml thrashosds-health.yaml} time: 00:43:30 info: http://pulpito.ceph.com/dzafman-2020-01-31_20:21:43-upgrade:mimic-x-master-distro-basic-smithi/4722102/ 2020-01-31T22:06:27.851 INFO:teuthology.results:starting coverage generation