2022-01-14T14:25:13.119 INFO:root:teuthology version: 1.1.0-6fc20113 2022-01-14T14:25:13.121 INFO:teuthology.results:subset: '2/10' 2022-01-14T14:25:13.121 INFO:teuthology.results:seed: '904' 2022-01-14T14:48:27.139 INFO:root:teuthology version: 1.1.0-6fc20113 2022-01-14T14:48:27.172 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-01-14T17:54:41.160 INFO:teuthology.results:Tests finished! gathering results... 2022-01-14T17:54:45.662 INFO:scrape:Found 40 jobs 2022-01-14T17:54:47.274 WARNING:scrape:Not-understood crash indication 2022-01-14T15:01:51.022 INFO:tasks.rgw.c2.client.0.smithi110.stderr:daemon-helper: command crashed with signal 11 2022-01-14T17:54:47.275 WARNING:scrape:Not-understood crash indication 2022-01-14T17:54:47.300 WARNING:scrape:Not-understood crash indication 2022-01-14T15:01:51.022 INFO:tasks.rgw.c2.client.0.smithi110.stderr:daemon-helper: command crashed with signal 11 2022-01-14T17:54:47.301 WARNING:scrape:Not-understood crash indication 2022-01-14T17:54:47.326 WARNING:scrape:Not-understood crash indication 2022-01-14T15:01:51.022 INFO:tasks.rgw.c2.client.0.smithi110.stderr:daemon-helper: command crashed with signal 11 2022-01-14T17:54:47.327 WARNING:scrape:Not-understood crash indication 2022-01-14T17:54:47.352 WARNING:scrape:Not-understood crash indication 2022-01-14T15:01:51.022 INFO:tasks.rgw.c2.client.0.smithi110.stderr:daemon-helper: command crashed with signal 11 2022-01-14T17:54:47.353 WARNING:scrape:Not-understood crash indication 2022-01-14T17:54:47.930 WARNING:scrape:Not-understood crash indication 2022-01-14T15:15:12.417 INFO:tasks.rgw.c2.client.0.smithi141.stderr:daemon-helper: command crashed with signal 11 2022-01-14T17:54:47.931 WARNING:scrape:Not-understood crash indication 2022-01-14T17:54:47.967 WARNING:scrape:Not-understood crash indication 2022-01-14T15:15:12.417 INFO:tasks.rgw.c2.client.0.smithi141.stderr:daemon-helper: command crashed with signal 11 2022-01-14T17:54:47.969 WARNING:scrape:Not-understood crash indication 2022-01-14T17:54:49.317 INFO:scrape:Found 2 distinct failure reasons 2022-01-14T17:54:49.319 INFO:scrape:Failure: Command failed on smithi049 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-10146-gbd05cede-1focal cephadm=17.0.0-10146-gbd05cede-1focal ceph-mds=17.0.0-10146-gbd05cede-1focal ceph-mgr=17.0.0-10146-gbd05cede-1focal ceph-common=17.0.0-10146-gbd05cede-1focal ceph-fuse=17.0.0-10146-gbd05cede-1focal ceph-test=17.0.0-10146-gbd05cede-1focal ceph-volume=17.0.0-10146-gbd05cede-1focal radosgw=17.0.0-10146-gbd05cede-1focal python3-rados=17.0.0-10146-gbd05cede-1focal python3-rgw=17.0.0-10146-gbd05cede-1focal python3-cephfs=17.0.0-10146-gbd05cede-1focal python3-rbd=17.0.0-10146-gbd05cede-1focal libcephfs2=17.0.0-10146-gbd05cede-1focal libcephfs-dev=17.0.0-10146-gbd05cede-1focal librados2=17.0.0-10146-gbd05cede-1focal librbd1=17.0.0-10146-gbd05cede-1focal rbd-fuse=17.0.0-10146-gbd05cede-1focal' 2022-01-14T17:54:49.319 INFO:scrape:8 jobs: ['6616392', '6616391', '6616371', '6616362', '6616361', '6616383', '6616370', '6616382'] 2022-01-14T17:54:49.320 INFO:scrape:suites intersection: ['2-partial-upgrade/firsthalf', '3-thrash/default', '5-finish-upgrade', '6-quincy', 'start}', 'thrashosds-health', 'ubuntu_20.04}'] 2022-01-14T17:54:49.320 INFO:scrape:suites union: ['1-ceph-install/octopus', '1-octopus-install/octopus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '3.1-objectstore/bluestore-hybrid', '3.1-objectstore/filestore-xfs', '4-ec-workload/{rados-ec-workload', '4-workload/{radosbench', '5-finish-upgrade', '6-quincy', '7-final-workload', '8-final-workload/{rbd-python', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'rbd-cls', 'rbd-ec-workload}', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_20.04}', 'upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack', 'upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack'] 2022-01-14T17:54:49.321 INFO:scrape: 2022-01-14T17:54:49.321 INFO:scrape:Failure: rgw multisite test failures 2022-01-14T17:54:49.321 INFO:scrape:2 jobs: ['6616360', '6616380'] 2022-01-14T17:54:49.322 INFO:scrape:suites intersection: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade:octopus-x/rgw-multisite/{clusters'] 2022-01-14T17:54:49.322 INFO:scrape:suites union: ['frontend', 'overrides', 'realm', 'tasks', 'upgrade/primary}', 'upgrade/secondary}', 'upgrade:octopus-x/rgw-multisite/{clusters'] 2022-01-14T17:54:49.323 INFO:scrape: 2022-01-14T17:54:49.326 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/ failed: 10 dead: 0 running: 0 waiting: 0 queued: 0 passed: 30 Fail ================================================================= [6616360] upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/primary} ----------------------------------------------------------------- time: 03:03:44 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616360/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616360/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a1b729eb4894e9eb364ce5d9544d853 rgw multisite test failures [6616361] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616361/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616361/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b2d893260ff04b659cdd88310bf9c05d Command failed on smithi041 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-10146-gbd05cede-1focal cephadm=17.0.0-10146-gbd05cede-1focal ceph-mds=17.0.0-10146-gbd05cede-1focal ceph- mgr=17.0.0-10146-gbd05cede-1focal ceph-common=17.0.0-10146-gbd05cede-1focal ceph-fuse=17.0.0-10146-gbd05cede-1focal ceph- test=17.0.0-10146-gbd05cede-1focal ceph- volume=17.0.0-10146-gbd05cede-1focal radosgw=17.0.0-10146-gbd05cede-1focal python3-rados=17.0.0-10146-gbd05cede-1focal python3-rgw=17.0.0-10146-gbd05cede-1focal python3-cephfs=17.0.0-10146-gbd05cede-1focal python3-rbd=17.0.0-10146-gbd05cede-1focal libcephfs2=17.0.0-10146-gbd05cede-1focal libcephfs- dev=17.0.0-10146-gbd05cede-1focal librados2=17.0.0-10146-gbd05cede-1focal librbd1=17.0.0-10146-gbd05cede-1focal rbd- fuse=17.0.0-10146-gbd05cede-1focal' [6616362] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616362/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616362/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d4032e4aadc5487a9a145f3b48ce6338 Command failed on smithi027 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-10146-gbd05cede-1focal cephadm=17.0.0-10146-gbd05cede-1focal ceph-mds=17.0.0-10146-gbd05cede-1focal ceph- mgr=17.0.0-10146-gbd05cede-1focal ceph-common=17.0.0-10146-gbd05cede-1focal ceph-fuse=17.0.0-10146-gbd05cede-1focal ceph- test=17.0.0-10146-gbd05cede-1focal ceph- volume=17.0.0-10146-gbd05cede-1focal radosgw=17.0.0-10146-gbd05cede-1focal python3-rados=17.0.0-10146-gbd05cede-1focal python3-rgw=17.0.0-10146-gbd05cede-1focal python3-cephfs=17.0.0-10146-gbd05cede-1focal python3-rbd=17.0.0-10146-gbd05cede-1focal libcephfs2=17.0.0-10146-gbd05cede-1focal libcephfs- dev=17.0.0-10146-gbd05cede-1focal librados2=17.0.0-10146-gbd05cede-1focal librbd1=17.0.0-10146-gbd05cede-1focal rbd- fuse=17.0.0-10146-gbd05cede-1focal' [6616370] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 00:09:07 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616370/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616370/ sentry: https://sentry.ceph.com/organizations/ceph/?query=200d040e5bcb436d81e14bfe2d5fc571 Command failed on smithi046 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-10146-gbd05cede-1focal cephadm=17.0.0-10146-gbd05cede-1focal ceph-mds=17.0.0-10146-gbd05cede-1focal ceph- mgr=17.0.0-10146-gbd05cede-1focal ceph-common=17.0.0-10146-gbd05cede-1focal ceph-fuse=17.0.0-10146-gbd05cede-1focal ceph- test=17.0.0-10146-gbd05cede-1focal ceph- volume=17.0.0-10146-gbd05cede-1focal radosgw=17.0.0-10146-gbd05cede-1focal python3-rados=17.0.0-10146-gbd05cede-1focal python3-rgw=17.0.0-10146-gbd05cede-1focal python3-cephfs=17.0.0-10146-gbd05cede-1focal python3-rbd=17.0.0-10146-gbd05cede-1focal libcephfs2=17.0.0-10146-gbd05cede-1focal libcephfs- dev=17.0.0-10146-gbd05cede-1focal librados2=17.0.0-10146-gbd05cede-1focal librbd1=17.0.0-10146-gbd05cede-1focal rbd- fuse=17.0.0-10146-gbd05cede-1focal' [6616371] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616371/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616371/ sentry: https://sentry.ceph.com/organizations/ceph/?query=de43912dd4bb48b79e7f03fed2be48cf Command failed on smithi090 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-10146-gbd05cede-1focal cephadm=17.0.0-10146-gbd05cede-1focal ceph-mds=17.0.0-10146-gbd05cede-1focal ceph- mgr=17.0.0-10146-gbd05cede-1focal ceph-common=17.0.0-10146-gbd05cede-1focal ceph-fuse=17.0.0-10146-gbd05cede-1focal ceph- test=17.0.0-10146-gbd05cede-1focal ceph- volume=17.0.0-10146-gbd05cede-1focal radosgw=17.0.0-10146-gbd05cede-1focal python3-rados=17.0.0-10146-gbd05cede-1focal python3-rgw=17.0.0-10146-gbd05cede-1focal python3-cephfs=17.0.0-10146-gbd05cede-1focal python3-rbd=17.0.0-10146-gbd05cede-1focal libcephfs2=17.0.0-10146-gbd05cede-1focal libcephfs- dev=17.0.0-10146-gbd05cede-1focal librados2=17.0.0-10146-gbd05cede-1focal librbd1=17.0.0-10146-gbd05cede-1focal rbd- fuse=17.0.0-10146-gbd05cede-1focal' [6616380] upgrade:octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} ----------------------------------------------------------------- time: 03:03:55 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616380/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616380/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d6b69071c0c34f78bdcd434d208a0366 rgw multisite test failures [6616382] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/classic thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 00:09:28 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616382/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616382/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8481d90622894db09128265d7f11ee9e Command failed on smithi003 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-10146-gbd05cede-1focal cephadm=17.0.0-10146-gbd05cede-1focal ceph-mds=17.0.0-10146-gbd05cede-1focal ceph- mgr=17.0.0-10146-gbd05cede-1focal ceph-common=17.0.0-10146-gbd05cede-1focal ceph-fuse=17.0.0-10146-gbd05cede-1focal ceph- test=17.0.0-10146-gbd05cede-1focal ceph- volume=17.0.0-10146-gbd05cede-1focal radosgw=17.0.0-10146-gbd05cede-1focal python3-rados=17.0.0-10146-gbd05cede-1focal python3-rgw=17.0.0-10146-gbd05cede-1focal python3-cephfs=17.0.0-10146-gbd05cede-1focal python3-rbd=17.0.0-10146-gbd05cede-1focal libcephfs2=17.0.0-10146-gbd05cede-1focal libcephfs- dev=17.0.0-10146-gbd05cede-1focal librados2=17.0.0-10146-gbd05cede-1focal librbd1=17.0.0-10146-gbd05cede-1focal rbd- fuse=17.0.0-10146-gbd05cede-1focal' [6616383] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616383/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616383/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc2a28e83bfe4b4f8ddd21cc0f1755ea Command failed on smithi057 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-10146-gbd05cede-1focal cephadm=17.0.0-10146-gbd05cede-1focal ceph-mds=17.0.0-10146-gbd05cede-1focal ceph- mgr=17.0.0-10146-gbd05cede-1focal ceph-common=17.0.0-10146-gbd05cede-1focal ceph-fuse=17.0.0-10146-gbd05cede-1focal ceph- test=17.0.0-10146-gbd05cede-1focal ceph- volume=17.0.0-10146-gbd05cede-1focal radosgw=17.0.0-10146-gbd05cede-1focal python3-rados=17.0.0-10146-gbd05cede-1focal python3-rgw=17.0.0-10146-gbd05cede-1focal python3-cephfs=17.0.0-10146-gbd05cede-1focal python3-rbd=17.0.0-10146-gbd05cede-1focal libcephfs2=17.0.0-10146-gbd05cede-1focal libcephfs- dev=17.0.0-10146-gbd05cede-1focal librados2=17.0.0-10146-gbd05cede-1focal librbd1=17.0.0-10146-gbd05cede-1focal rbd- fuse=17.0.0-10146-gbd05cede-1focal' [6616391] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-quincy 7-final-workload mon_election/connectivity thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616391/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616391/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24cf97417b6446ad83e7c778211e5ae9 Command failed on smithi060 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-10146-gbd05cede-1focal cephadm=17.0.0-10146-gbd05cede-1focal ceph-mds=17.0.0-10146-gbd05cede-1focal ceph- mgr=17.0.0-10146-gbd05cede-1focal ceph-common=17.0.0-10146-gbd05cede-1focal ceph-fuse=17.0.0-10146-gbd05cede-1focal ceph- test=17.0.0-10146-gbd05cede-1focal ceph- volume=17.0.0-10146-gbd05cede-1focal radosgw=17.0.0-10146-gbd05cede-1focal python3-rados=17.0.0-10146-gbd05cede-1focal python3-rgw=17.0.0-10146-gbd05cede-1focal python3-cephfs=17.0.0-10146-gbd05cede-1focal python3-rbd=17.0.0-10146-gbd05cede-1focal libcephfs2=17.0.0-10146-gbd05cede-1focal libcephfs- dev=17.0.0-10146-gbd05cede-1focal librados2=17.0.0-10146-gbd05cede-1focal librbd1=17.0.0-10146-gbd05cede-1focal rbd- fuse=17.0.0-10146-gbd05cede-1focal' [6616392] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-quincy 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_20.04} ----------------------------------------------------------------- time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616392/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616392/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b1e2d9fe6f5a4b3587b771b1de650dff Command failed on smithi049 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-10146-gbd05cede-1focal cephadm=17.0.0-10146-gbd05cede-1focal ceph-mds=17.0.0-10146-gbd05cede-1focal ceph- mgr=17.0.0-10146-gbd05cede-1focal ceph-common=17.0.0-10146-gbd05cede-1focal ceph-fuse=17.0.0-10146-gbd05cede-1focal ceph- test=17.0.0-10146-gbd05cede-1focal ceph- volume=17.0.0-10146-gbd05cede-1focal radosgw=17.0.0-10146-gbd05cede-1focal python3-rados=17.0.0-10146-gbd05cede-1focal python3-rgw=17.0.0-10146-gbd05cede-1focal python3-cephfs=17.0.0-10146-gbd05cede-1focal python3-rbd=17.0.0-10146-gbd05cede-1focal libcephfs2=17.0.0-10146-gbd05cede-1focal libcephfs- dev=17.0.0-10146-gbd05cede-1focal librados2=17.0.0-10146-gbd05cede-1focal librbd1=17.0.0-10146-gbd05cede-1focal rbd- fuse=17.0.0-10146-gbd05cede-1focal' Pass ================================================================= [6616357] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:08:28 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616357/ [6616358] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:09:49 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616358/ [6616359] upgrade:octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:03:53 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616359/ [6616363] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:34:57 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616363/ [6616364] upgrade:octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:40 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616364/ [6616365] upgrade:octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 01:55:51 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616365/ [6616366] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:02:49 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616366/ [6616367] upgrade:octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:23:12 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616367/ [6616368] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 01:48:08 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616368/ [6616369] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:41 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616369/ [6616372] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:12:16 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616372/ [6616373] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:02 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616373/ [6616374] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:07:59 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616374/ [6616375] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:20 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616375/ [6616376] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:16:06 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616376/ [6616377] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:09:01 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616377/ [6616378] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:09:41 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616378/ [6616379] upgrade:octopus-x/parallel/{0-distro/centos_8.2_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:05:13 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616379/ [6616381] upgrade:octopus-x/stress-split/{0-distro/centos_8.2_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:11:54 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616381/ [6616384] upgrade:octopus-x/stress-split/{0-distro/centos_8.3_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:01:32 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616384/ [6616385] upgrade:octopus-x/parallel/{0-distro/centos_8.3_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:52 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616385/ [6616386] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:06:29 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616386/ [6616387] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:52 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616387/ [6616388] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools_crun 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:54:53 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616388/ [6616389] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools_crun 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:01:55 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616389/ [6616390] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:17:56 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616390/ [6616393] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:19 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616393/ [6616394] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:29:07 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616394/ [6616395] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:45 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616395/ [6616396] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:25:11 info: http://pulpito.ceph.com/teuthology-2022-01-14_14:22:02-upgrade:octopus-x-master-distro-default-smithi/6616396/