2021-05-22T16:52:04.070 INFO:root:teuthology version: 1.1.0-d92ec140 2021-05-22T16:52:04.072 INFO:teuthology.results:seed: '3166' 2021-05-23T04:36:56.837 INFO:root:teuthology version: 1.1.0-d92ec140 2021-05-23T04:36:56.867 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-05-23T06:46:05.287 INFO:teuthology.results:Tests finished! gathering results... 2021-05-23T06:46:07.226 INFO:scrape:Found 16 jobs 2021-05-23T06:46:07.229 INFO:scrape:Found 1 distinct failure reasons 2021-05-23T06:46:07.230 INFO:scrape:Failure: Command failed on gibba007 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 2021-05-23T06:46:07.230 INFO:scrape:1 jobs: ['6129012'] 2021-05-23T06:46:07.231 INFO:scrape:suites: ['1-ceph-install/mimic', '1.1-pg-log-overrides/normal_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-octopus', '7-msgr2', '8-final-workload/{rbd-python', 'objectstore/bluestore-bitmap', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}', 'upgrade:mimic-x/stress-split/{0-cluster/{openstack'] 2021-05-23T06:46:07.231 INFO:scrape: 2021-05-23T06:46:07.232 INFO:teuthology.results:Sending results to ceph-qa@ceph.com: Test Run: teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 15 Fail ================================================================= [6129012] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 03:06:14 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129012/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129012/ Command failed on gibba007 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" Pass ================================================================= [6129011] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_latest} time: 02:04:23 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129011/ [6129013] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/bluestore-bitmap thrashosds-health ubuntu_latest} time: 00:50:02 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129013/ [6129014] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_latest} time: 01:57:12 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129014/ [6129015] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_latest} time: 02:05:51 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129015/ [6129016] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_latest} time: 02:56:55 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129016/ [6129017] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/filestore-xfs thrashosds-health ubuntu_latest} time: 00:45:31 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129017/ [6129018] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_latest} time: 01:56:47 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129018/ [6129019] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_latest} time: 02:02:34 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129019/ [6129020] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_latest} time: 04:53:34 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129020/ [6129021] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/bluestore-bitmap thrashosds-health ubuntu_latest} time: 00:47:48 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129021/ [6129022] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_latest} time: 01:58:42 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129022/ [6129023] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_latest} time: 02:04:12 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129023/ [6129024] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_latest} time: 02:46:13 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129024/ [6129025] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/filestore-xfs thrashosds-health ubuntu_latest} time: 00:46:48 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129025/ [6129026] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_latest} time: 01:58:17 info: http://pulpito.ceph.com/teuthology-2021-05-22_16:19:38-upgrade:mimic-x-octopus-distro-basic-gibba/6129026/