2020-11-10T01:51:06.798 INFO:root:teuthology version: 1.0.0-79c79b9 2020-11-10T01:51:06.799 INFO:teuthology.results:seed: '5119' 2020-11-10T02:20:50.942 INFO:root:teuthology version: 1.0.0-79c79b9 2020-11-10T02:20:50.981 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-10T14:09:04.118 INFO:teuthology.results:Tests finished! gathering results... 2020-11-10T14:09:09.502 INFO:scrape:Found 41 jobs 2020-11-10T14:09:10.042 INFO:scrape:Found 2 distinct failure reasons 2020-11-10T14:09:10.043 INFO:scrape:Dead: b'2020-11-10T14:06:03.870 DEBUG:teuthology.exit:Finished running handlers' 2020-11-10T14:09:10.043 INFO:scrape:2 jobs: ['5607368', '5607367'] 2020-11-10T14:09:10.044 INFO:scrape:suites intersection: ['1.1-pg-log-overrides/short_pg_log', 'start}', 'ubuntu_18.04}'] 2020-11-10T14:09:10.044 INFO:scrape:suites union: ['1-ceph-install/nautilus', '1-nautilus-install/nautilus', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '2-workload/{blogbench', '3-thrash/default', '3-upgrade-sequence/upgrade-all', '3.1-objectstore/bluestore-bitmap', '4-ec-workload/{rados-ec-workload', '4-octopus', '5-final-workload/{blogbench', '5-finish-upgrade', '6-octopus', '7-final-workload', 'ec-rados-default', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/filestore-xfs', 'rados-snaps-few-objects', 'rados_api', 'rados_loadgenbig', 'rados_loadgenmix', 'rados_mon_thrash', 'rbd-ec-workload}', 'rbd_cls', 'rbd_import_export', 'rgw', 'rgw_ragweed_check}', 'rgw_ragweed_prepare', 'start}', 'test_rbd_api', 'test_rbd_python}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade/nautilus-x/parallel/{0-cluster/{openstack', 'upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack'] 2020-11-10T14:09:10.044 INFO:scrape: 2020-11-10T14:09:10.045 INFO:scrape:Dead: b'2020-11-10T13:57:58.943 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 5, have 0)...' 2020-11-10T14:09:10.045 INFO:scrape:3 jobs: ['5607357', '5607360', '5607351'] 2020-11-10T14:09:10.045 INFO:scrape: 2020-11-10T14:09:10.049 INFO:teuthology.results:Sending results to dzafman@redhat.com: Test Run: dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/ failed: 0 dead: 5 running: 0 waiting: 0 queued: 0 passed: 36 Dead ================================================================= [5607351] upgrade/nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607351/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607351/ [5607357] upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607357/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607357/ [5607360] upgrade/nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607360/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607360/ [5607367] upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607367/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607367/ [5607368] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607368/ log: http://qa-proxy.ceph.com/teuthology/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607368/ Pass ================================================================= [5607348] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}} time: 00:32:07 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607348/ [5607349] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} time: 02:31:48 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607349/ [5607350] upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:27:42 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607350/ [5607352] upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 03:25:13 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607352/ [5607353] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} time: 02:10:26 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607353/ [5607354] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} time: 02:27:39 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607354/ [5607355] upgrade/cephfs/volumes/import-legacy/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-verify} ubuntu_18.04} time: 01:16:00 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607355/ [5607356] upgrade/nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:25:44 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607356/ [5607358] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} time: 02:11:52 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607358/ [5607359] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} time: 02:28:14 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607359/ [5607361] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:18:58 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607361/ [5607362] upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 01:51:33 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607362/ [5607363] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} time: 02:10:19 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607363/ [5607364] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} time: 02:27:27 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607364/ [5607365] upgrade/nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:12:23 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607365/ [5607366] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:19:48 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607366/ [5607369] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} time: 02:28:25 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607369/ [5607370] upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:11:04 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607370/ [5607371] upgrade/nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 04:47:31 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607371/ [5607372] upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 03:19:29 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607372/ [5607373] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/no}} time: 00:30:58 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607373/ [5607374] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} time: 02:10:21 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607374/ [5607375] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} time: 02:26:47 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607375/ [5607376] upgrade/nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:15:37 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607376/ [5607377] upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 01:55:26 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607377/ [5607378] upgrade/cephfs/featureful_client/upgraded_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/yes pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} time: 00:19:47 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607378/ [5607379] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} time: 02:12:38 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607379/ [5607380] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} time: 02:24:45 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607380/ [5607381] upgrade/nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 04:57:26 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607381/ [5607382] upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 01:39:29 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607382/ [5607383] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} time: 02:12:41 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607383/ [5607384] upgrade/cephfs/featureful_client/old_client/{bluestore-bitmap clusters/1-mds-2-client-micro conf/{client mds mon osd} overrides/{frag_enable multimds/no pg-warn whitelist_health whitelist_wrongly_marked_down} tasks/{0-nautilus 1-client 2-upgrade 3-compat_client/pacific}} time: 00:21:13 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607384/ [5607385] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} time: 02:22:39 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607385/ [5607386] upgrade/nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:05:42 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607386/ [5607387] upgrade/nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:37:23 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607387/ [5607388] upgrade/nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} time: 02:11:43 info: http://pulpito.ceph.com/dzafman-2020-11-09_17:18:57-upgrade-wip-zafman-testing-46264-2-distro-basic-smithi/5607388/