2020-12-31T14:29:51.505 INFO:root:teuthology version: 1.0.0-8e49dda4 2020-12-31T14:29:51.507 INFO:teuthology.results:seed: '2510' 2020-12-31T15:03:52.038 INFO:root:teuthology version: 1.0.0-8e49dda4 2020-12-31T15:03:52.068 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-01T03:01:05.000 INFO:teuthology.results:Tests finished! gathering results... 2021-01-01T03:01:14.993 INFO:scrape:Found 32 jobs 2021-01-01T03:01:22.846 INFO:scrape:Found 2 distinct failure reasons 2021-01-01T03:01:22.847 INFO:scrape:Failure: Command failed on smithi144 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' 2021-01-01T03:01:22.847 INFO:scrape:23 jobs: ['5749265', '5749258', '5749285', '5749254', '5749261', '5749282', '5749267', '5749255', '5749257', '5749277', '5749259', '5749274', '5749269', '5749275', '5749270', '5749263', '5749281', '5749278', '5749273', '5749271', '5749283', '5749262', '5749266'] 2021-01-01T03:01:22.848 INFO:scrape:suites intersection: ['1-ceph-install/nautilus', 'rgw_ragweed_prepare', 'start}', 'ubuntu_18.04}'] 2021-01-01T03:01:22.849 INFO:scrape:suites union: ['1-ceph-install/nautilus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '2-workload/{blogbench', '3-thrash/default', '3-upgrade-sequence/upgrade-all', '3-upgrade-sequence/upgrade-mon-osd-mds', '4-octopus', '4-workload/{radosbench', '5-final-workload/{blogbench', '5-finish-upgrade', '6-octopus', '7-msgr2', '8-final-workload/{rbd-python', 'ec-rados-default', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'rados-snaps-few-objects', 'rados_api', 'rados_loadgenbig', 'rados_loadgenmix', 'rados_mon_thrash', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'rbd_cls', 'rbd_import_export', 'readwrite', 'rgw', 'rgw_ragweed_check}', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'test_rbd_api', 'test_rbd_python}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade:nautilus-x/parallel/{0-cluster/{openstack', 'upgrade:nautilus-x/stress-split/{0-cluster/{openstack'] 2021-01-01T03:01:22.849 INFO:scrape: 2021-01-01T03:01:22.850 INFO:scrape:Dead: b'2021-01-01T02:58:08.644 DEBUG:teuthology.exit:Finished running handlers' 2021-01-01T03:01:22.850 INFO:scrape:1 jobs: ['5749279'] 2021-01-01T03:01:22.850 INFO:scrape:suites: ['1-ceph-install/nautilus', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-octopus', '7-msgr2', '8-final-workload/{rbd-python', 'mon_election/connectivity', 'objectstore/bluestore-bitmap', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade:nautilus-x/stress-split/{0-cluster/{openstack'] 2021-01-01T03:01:22.851 INFO:scrape: 2021-01-01T03:01:22.854 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/ failed: 23 dead: 1 running: 0 waiting: 0 queued: 0 passed: 8 Fail ================================================================= [5749254] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 01:13:38 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749254/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749254/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b82ec679fe084f18a8a47a7a91e057d5 Command failed on smithi083 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749255] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 03:49:08 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749255/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749255/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14184d6171de455b869d3c60748624ab Command failed on smithi080 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749257] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 01:10:46 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749257/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749257/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5568ee9ed9464244a77e1e8ad8f34eee Command failed on smithi154 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749258] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 01:14:36 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749258/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749258/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a466507e4af4372993087f5756d8be3 Command failed on smithi023 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749259] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 02:10:02 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749259/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a2a4a3d6010342de9508a8651d728c26 Command failed on smithi049 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749261] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 01:09:45 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749261/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749261/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a45a86a25a4421c9abea700e8f8d21a Command failed on smithi139 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749262] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 01:14:50 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749262/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749262/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dd6865d8545c4a20b39b91ba5ba1ad48 Command failed on smithi095 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749263] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 03:32:47 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749263/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749263/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c020c18865849e39ab196181609367b Command failed on smithi125 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749265] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 01:10:14 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749265/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749265/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99c3d0608e4b4fff8e197b86cdc6c082 Command failed on smithi144 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749266] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 01:14:34 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749266/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749266/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5fd2fce107d74fc493645c139b3733ff Command failed on smithi135 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749267] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 02:13:14 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749267/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749267/ sentry: https://sentry.ceph.com/organizations/ceph/?query=824e9f9e8a424e81929c88774e0dcbe2 Command failed on smithi161 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749269] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 01:09:24 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749269/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e516f8f039df40b9bf29e1127c3ebf9b Command failed on smithi105 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749270] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 01:15:24 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749270/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749270/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c4789987d7864060a1547044d3e278fa Command failed on smithi122 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749271] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 04:03:23 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749271/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749271/ sentry: https://sentry.ceph.com/organizations/ceph/?query=030aea3eab8c45adb3f6a304bd0f3dfb Command failed on smithi136 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749273] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 01:08:44 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749273/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749273/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b437adf6e354db3bc64ef45211b98d4 Command failed on smithi164 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749274] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 01:13:45 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749274/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749274/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f34a4aab8e3f4b36ba42a9b1a0609d39 Command failed on smithi029 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749275] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 02:08:29 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749275/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749275/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cee42345ef8c4271b42c30bd96c394cd Command failed on smithi123 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749277] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 01:09:38 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749277/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749277/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3bda7c72603d4696bb47bfe0aaae96dd Command failed on smithi155 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749278] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 01:14:16 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749278/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749278/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f94cc74718384d058226c1b38fbe62ac Command failed on smithi045 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749281] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 01:08:32 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749281/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749281/ sentry: https://sentry.ceph.com/organizations/ceph/?query=12052942ab744edf8bdd3cfb26d25c35 Command failed on smithi124 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749282] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 01:13:35 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749282/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749282/ sentry: https://sentry.ceph.com/organizations/ceph/?query=280897e31d604ce494085e235020d495 Command failed on smithi028 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749283] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 02:17:04 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749283/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749283/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb39d1ef74e148e8b65d070ebf3626b5 Command failed on smithi196 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' [5749285] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 01:09:39 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749285/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749285/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0bb45a32e7f846e9aea1e3f5f0a6f1bb Command failed on smithi121 with status 1: 'cd /home/ubuntu/cephtest/ragweed && ./bootstrap' Dead ================================================================= [5749279] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749279/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749279/ Pass ================================================================= [5749256] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 03:21:41 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749256/ [5749260] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 01:42:36 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749260/ [5749264] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 02:01:37 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749264/ [5749268] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:10:22 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749268/ [5749272] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 03:24:21 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749272/ [5749276] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 02:04:41 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749276/ [5749280] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 01:44:29 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749280/ [5749284] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:18:18 info: http://pulpito.ceph.com/teuthology-2020-12-31_14:23:02-upgrade:nautilus-x-master-distro-basic-smithi/5749284/