2021-10-01T10:03:58.662 INFO:root:teuthology version: 1.1.0-f08b273e 2021-10-01T10:03:58.663 INFO:teuthology.results:seed: '280' 2021-10-01T11:07:45.181 INFO:root:teuthology version: 1.1.0-f08b273e 2021-10-01T11:07:45.184 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-01T11:21:46.147 INFO:teuthology.results:Tests finished! gathering results... 2021-10-01T11:21:46.961 INFO:scrape:Found 16 jobs 2021-10-01T11:21:47.361 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405693/teuthology.log 2021-10-01T11:21:47.385 INFO:scrape:Found 2 distinct failure reasons 2021-10-01T11:21:47.386 INFO:scrape:Failure: Command failed on gibba002 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph-common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' 2021-10-01T11:21:47.387 INFO:scrape:15 jobs: ['6405704', '6405706', '6405700', '6405705', '6405702', '6405701', '6405692', '6405697', '6405694', '6405696', '6405699', '6405695', '6405703', '6405698', '6405707'] 2021-10-01T11:21:47.387 INFO:scrape:suites intersection: ['start}', 'ubuntu_18.04}'] 2021-10-01T11:21:47.388 INFO:scrape:suites union: ['1-ceph-install/nautilus', '1-nautilus-install/nautilus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '2-workload/{blogbench', '3-thrash/default', '3-upgrade-sequence/upgrade-all', '3-upgrade-sequence/upgrade-mon-osd-mds', '3.1-objectstore/bluestore-bitmap', '3.1-objectstore/filestore-xfs', '4-ec-workload/{rados-ec-workload', '4-octopus', '4-workload/{radosbench', '5-final-workload/{blogbench', '5-finish-upgrade', '6-octopus', '7-final-workload', '7-msgr2', '8-final-workload/{rbd-python', 'ec-rados-default', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'rados-snaps-few-objects', 'rados_api', 'rados_loadgenbig', 'rados_loadgenmix', 'rados_mon_thrash', 'rbd-cls', 'rbd-ec-workload}', 'rbd-import-export', 'rbd_api', 'rbd_cls', 'rbd_import_export', 'readwrite', 'rgw', 'rgw_ragweed_check}', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'test_rbd_api', 'test_rbd_python}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade:nautilus-x/parallel/{0-cluster/{openstack', 'upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack', 'upgrade:nautilus-x/stress-split/{0-cluster/{openstack'] 2021-10-01T11:21:47.388 INFO:scrape: 2021-10-01T11:21:47.389 INFO:scrape:Dead: None 2021-10-01T11:21:47.389 INFO:scrape:1 jobs: ['6405693'] 2021-10-01T11:21:47.389 INFO:scrape: 2021-10-01T11:21:47.391 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/ failed: 15 dead: 1 running: 0 waiting: 0 queued: 0 passed: 0 Fail ================================================================= [6405692] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:09 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405692/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405692/ sentry: https://sentry.ceph.com/organizations/ceph/?query=919d0e7a72b742cf99579a8bae56d263 Command failed on gibba022 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405694] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:20 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405694/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405694/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26aa1f94b06e436488d6be73db2b16e3 Command failed on gibba035 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405695] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:12 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405695/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405695/ sentry: https://sentry.ceph.com/organizations/ceph/?query=90fd68bfb7f248f4a57064a7fe359997 Command failed on gibba022 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405696] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:08 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405696/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405696/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92f444f1a92543a28541abe69776d9b3 Command failed on gibba001 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405697] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:21 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405697/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405697/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25a966b1674f4d8386ed498ed93f461a Command failed on gibba035 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405698] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:21 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405698/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405698/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6774e4f7cabc4e75b192b43f858be92f Command failed on gibba031 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405699] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:12 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405699/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405699/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3878425c2291455a89a460fc048f1f89 Command failed on gibba001 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405700] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:15 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405700/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405700/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9655184163fc488e9da42b41479b5cea Command failed on gibba041 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405701] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405701/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405701/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5cc559ae21dc45c6abe3ca096bf61d51 Command failed on gibba010 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405702] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:20 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405702/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405702/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bda28767caa645858e4c38445006148d Command failed on gibba020 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405703] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405703/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405703/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b743bc6cea814e07ab079477a0c5c29e Command failed on gibba031 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405704] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:12 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405704/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405704/ sentry: https://sentry.ceph.com/organizations/ceph/?query=debfe688848a48fbaabf8de57a89369f Command failed on gibba002 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405705] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:25 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405705/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405705/ sentry: https://sentry.ceph.com/organizations/ceph/?query=23109daed2d54d12b8aade7770cdd63d Command failed on gibba041 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405706] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:26 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405706/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405706/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a53ea8a77f7d4c009b5a8070ee5e44e5 Command failed on gibba018 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' [6405707] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:03:15 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405707/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405707/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9132396db6ed4bf7bf4c0e2f89e462fe Command failed on gibba027 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.22-19-g29bda6fd-1bionic ceph-mds=14.2.22-19-g29bda6fd-1bionic ceph-mgr=14.2.22-19-g29bda6fd-1bionic ceph- common=14.2.22-19-g29bda6fd-1bionic ceph-fuse=14.2.22-19-g29bda6fd-1bionic ceph-test=14.2.22-19-g29bda6fd-1bionic radosgw=14.2.22-19-g29bda6fd-1bionic python3-rados=14.2.22-19-g29bda6fd-1bionic python3-rgw=14.2.22-19-g29bda6fd-1bionic python3-cephfs=14.2.22-19-g29bda6fd-1bionic python3-rbd=14.2.22-19-g29bda6fd-1bionic libcephfs2=14.2.22-19-g29bda6fd-1bionic librados2=14.2.22-19-g29bda6fd-1bionic librbd1=14.2.22-19-g29bda6fd-1bionic rbd-fuse=14.2.22-19-g29bda6fd-1bionic' Dead ================================================================= [6405693] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405693/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-24_14:23:02-upgrade:nautilus-x-octopus-distro-basic-gibba/6405693/ Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds