2022-04-07T11:03:10.761 INFO:root:teuthology version: 1.1.0-3dd79763 2022-04-07T11:03:10.763 INFO:teuthology.results:seed: '8081' 2022-04-07T11:31:02.423 INFO:root:teuthology version: 1.1.0-3dd79763 2022-04-07T11:31:02.425 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-07T15:56:20.769 INFO:teuthology.results:Tests finished! gathering results... 2022-04-07T15:56:22.348 INFO:scrape:Found 16 jobs 2022-04-07T15:56:22.351 INFO:scrape:Found 1 distinct failure reasons 2022-04-07T15:56:22.351 INFO:scrape:Failure: Command failed (ragweed tests against rgw) on smithi151 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'" 2022-04-07T15:56:22.352 INFO:scrape:1 jobs: ['6780350'] 2022-04-07T15:56:22.352 INFO:scrape:suites: ['1-ceph-install/mimic', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-octopus', '7-msgr2', '8-final-workload/{rbd-python', 'objectstore/bluestore-bitmap', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade:mimic-x/stress-split/{0-cluster/{openstack'] 2022-04-07T15:56:22.352 INFO:scrape: 2022-04-07T15:56:22.353 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 15 Fail ================================================================= [6780350] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 04:02:42 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780350/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780350/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8fc3b757f44a4cf8979da782a887c458 Command failed (ragweed tests against rgw) on smithi151 with status 1: "RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/python -m nose -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw'" Pass ================================================================= [6780341] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:06:54 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780341/ [6780342] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 04:42:11 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780342/ [6780343] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 00:49:22 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780343/ [6780344] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 01:59:01 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780344/ [6780345] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:04:40 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780345/ [6780346] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 02:28:18 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780346/ [6780347] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 00:46:37 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780347/ [6780348] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 01:55:25 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780348/ [6780349] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:04:33 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780349/ [6780351] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 00:56:49 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780351/ [6780352] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 01:57:21 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780352/ [6780353] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} time: 02:03:53 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780353/ [6780354] upgrade:mimic-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 02:35:08 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780354/ [6780355] upgrade:mimic-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-luminous-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-ec-workload 5-finish-upgrade 6-octopus 7-final-workload objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 00:52:46 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780355/ [6780356] upgrade:mimic-x/parallel/{0-cluster/{openstack start} 1-ceph-install/mimic 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-msgr2 6-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} time: 01:55:55 info: http://pulpito.ceph.com/teuthology-2022-04-07_02:30:02-upgrade:mimic-x-octopus-distro-default-smithi/6780356/