2020-02-19T20:29:28.275 INFO:root:teuthology version: 1.0.0-a023d65 2020-02-19T20:29:28.276 INFO:teuthology.results:subset: '2/40' 2020-02-19T20:29:28.276 INFO:teuthology.results:seed: '1961' 2020-02-19T22:27:38.305 INFO:root:teuthology version: 1.0.0-a023d65 2020-02-19T22:27:38.353 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-02-20T05:29:45.345 INFO:teuthology.results:Tests finished! gathering results... 2020-02-20T05:29:46.135 INFO:teuthology.results:Sending results to gfarnum@redhat.com: Test Run: gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira ================================================================= info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/ logs: http://qa-proxy.ceph.com/teuthology/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/ failed: 6 dead: 2 running: 0 waiting: 0 queued: 0 passed: 4 Fail ================================================================= [4782583] upgrade:nautilus-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-msgr2.yaml 8-final-workload/{rbd-python.yaml snaps-many-objects.yaml} mon_election/connectivity.yaml objectstore/filestore-xfs.yaml thrashosds-health.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:17:18 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782583/ log: http://qa-proxy.ceph.com/teuthology/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782583/ Command failed on mira062 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch nautilus https://github.com/gregsfortytwo/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0' [4782575] upgrade:nautilus-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-octopus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml} mon_election/connectivity.yaml objectstore/bluestore-bitmap.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:41:08 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782575/ log: http://qa-proxy.ceph.com/teuthology/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782575/ Command failed on mira083 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch nautilus https://github.com/gregsfortytwo/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0' [4782587] upgrade:nautilus-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-octopus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml} mon_election/connectivity.yaml objectstore/bluestore-bitmap.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:23:37 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782587/ log: http://qa-proxy.ceph.com/teuthology/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782587/ Command failed on mira016 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set teuthologyprofile crush- failure-domain=osd k=2 m=1' [4782577] upgrade:nautilus-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-msgr2.yaml 8-final-workload/{rbd-python.yaml snaps-many-objects.yaml} mon_election/connectivity.yaml objectstore/bluestore-bitmap.yaml thrashosds-health.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:17:11 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782577/ log: http://qa-proxy.ceph.com/teuthology/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782577/ Command failed on mira062 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch nautilus https://github.com/gregsfortytwo/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0' [4782589] upgrade:nautilus-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-msgr2.yaml 8-final-workload/{rbd-python.yaml snaps-many-objects.yaml} mon_election/connectivity.yaml objectstore/bluestore-bitmap.yaml thrashosds-health.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:17:25 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782589/ log: http://qa-proxy.ceph.com/teuthology/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782589/ Command failed on mira053 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch nautilus https://github.com/gregsfortytwo/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0' [4782593] upgrade:nautilus-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-octopus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml} mon_election/connectivity.yaml objectstore/filestore-xfs.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:41:42 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782593/ log: http://qa-proxy.ceph.com/teuthology/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782593/ Command failed on mira083 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch nautilus https://github.com/gregsfortytwo/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0' Dead ================================================================= [4782581] upgrade:nautilus-x/parallel/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-workload/{blogbench.yaml ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml rgw_ragweed_prepare.yaml test_rbd_api.yaml test_rbd_python.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-octopus.yaml 5-final-workload/{blogbench.yaml rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml rgw.yaml rgw_ragweed_check.yaml} mon_election/connectivity.yaml objectstore/filestore-xfs.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782581/ log: http://qa-proxy.ceph.com/teuthology/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782581/ reached maximum tries (60) after waiting for 900 seconds [4782594] upgrade:nautilus-x/stress-split/{0-cluster/{openstack.yaml start.yaml} 1-ceph-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{radosbench.yaml rbd-cls.yaml rbd-import-export.yaml rbd_api.yaml readwrite.yaml rgw_ragweed_prepare.yaml snaps-few-objects.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-msgr2.yaml 8-final-workload/{rbd-python.yaml snaps-many-objects.yaml} mon_election/connectivity.yaml objectstore/filestore-xfs.yaml thrashosds-health.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782594/ log: http://qa-proxy.ceph.com/teuthology/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782594/ reached maximum tries (60) after waiting for 900 seconds Pass ================================================================= [4782596] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/filestore-xfs.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-final-workload.yaml mon_election/connectivity.yaml thrashosds-health.yaml ubuntu_latest.yaml} time: 03:23:13 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782596/ [4782579] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/normal_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/bluestore-bitmap.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-final-workload.yaml mon_election/connectivity.yaml thrashosds-health.yaml ubuntu_latest.yaml} time: 03:59:15 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782579/ [4782585] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/filestore-xfs.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-final-workload.yaml mon_election/connectivity.yaml thrashosds-health.yaml ubuntu_latest.yaml} time: 03:04:44 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782585/ [4782591] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack.yaml start.yaml} 1-nautilus-install/nautilus.yaml 1.1-pg-log-overrides/short_pg_log.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 3.1-objectstore/bluestore-bitmap.yaml 4-ec-workload/{rados-ec-workload.yaml rbd-ec-workload.yaml} 5-finish-upgrade.yaml 6-octopus.yaml 7-final-workload.yaml mon_election/connectivity.yaml thrashosds-health.yaml ubuntu_latest.yaml} time: 03:04:32 info: http://pulpito.ceph.com/gregf-2020-02-19_16:53:10-upgrade:nautilus-x-wip-elector-squash-212-distro-basic-mira/4782591/ 2020-02-20T05:29:46.258 INFO:teuthology.results:starting coverage generation