2021-10-09T16:43:42.683 INFO:root:teuthology version: 1.1.0-6f40c4ca 2021-10-09T16:43:42.685 INFO:teuthology.results:seed: '7492' 2021-10-09T18:18:21.738 INFO:root:teuthology version: 1.1.0-6f40c4ca 2021-10-09T18:18:21.744 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-09T20:27:30.000 INFO:teuthology.results:Tests finished! gathering results... 2021-10-09T20:27:30.710 INFO:scrape:Found 16 jobs 2021-10-09T20:27:30.711 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428592/teuthology.log 2021-10-09T20:27:30.715 INFO:scrape:Found 1 distinct failure reasons 2021-10-09T20:27:30.715 INFO:scrape:Dead: None 2021-10-09T20:27:30.716 INFO:scrape:11 jobs: ['6428592', '6428602', '6428591', '6428595', '6428599', '6428601', '6428597', '6428605', '6428606', '6428604', '6428600'] 2021-10-09T20:27:30.716 INFO:scrape: 2021-10-09T20:27:30.717 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/ failed: 0 dead: 11 running: 0 waiting: 0 queued: 0 passed: 5 Dead ================================================================= [6428591] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428591/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428591/ Error reimaging machines: Failed to power on gibba027 [6428592] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428592/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428592/ Error reimaging machines: Failed to power on gibba027 [6428595] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428595/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428595/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds [6428597] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428597/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428597/ Error reimaging machines: Failed to power on gibba027 [6428599] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428599/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428599/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds [6428600] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428600/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428600/ Error reimaging machines: Failed to power on gibba027 [6428601] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428601/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428601/ Error reimaging machines: Failed to power on gibba027 [6428602] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428602/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428602/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds [6428604] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428604/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428604/ Error reimaging machines: Failed to power on gibba027 [6428605] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428605/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428605/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds [6428606] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428606/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428606/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds Pass ================================================================= [6428593] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} time: 00:49:34 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428593/ [6428594] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 02:02:05 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428594/ [6428596] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:10:08 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428596/ [6428598] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 02:00:41 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428598/ [6428603] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:05:41 info: http://pulpito.ceph.com/teuthology-2021-10-08_14:23:03-upgrade:nautilus-x-octopus-distro-basic-gibba/6428603/