2021-10-16T14:23:08.632 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-16T14:23:08.633 INFO:teuthology.results:seed: '8274' 2021-10-16T18:00:44.741 INFO:root:teuthology version: 1.1.0-b35344e8 2021-10-16T18:00:44.779 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-16T22:40:03.093 INFO:teuthology.results:Tests finished! gathering results... 2021-10-16T22:40:06.994 INFO:scrape:Found 32 jobs 2021-10-16T22:40:07.740 INFO:scrape:Found 3 distinct failure reasons 2021-10-16T22:40:07.741 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json 2021-10-16T22:40:07.742 INFO:scrape:7 jobs: ['6446018', '6446013', '6446019', '6446023', '6446020', '6446017', '6446016'] 2021-10-16T22:40:07.742 INFO:scrape:suites intersection: ['start}', 'ubuntu_18.04}'] 2021-10-16T22:40:07.743 INFO:scrape:suites union: ['1-ceph-install/nautilus', '1-nautilus-install/nautilus', '1.1-pg-log-overrides/normal_pg_log', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '2-workload/{blogbench', '3-thrash/default', '3-upgrade-sequence/upgrade-mon-osd-mds', '3.1-objectstore/filestore-xfs', '4-ec-workload/{rados-ec-workload', '4-octopus', '4-workload/{radosbench', '5-final-workload/{blogbench', '5-finish-upgrade', '6-octopus', '7-final-workload', '7-msgr2', '8-final-workload/{rbd-python', 'ec-rados-default', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'rados-snaps-few-objects', 'rados_api', 'rados_loadgenbig', 'rados_loadgenmix', 'rados_mon_thrash', 'rbd-cls', 'rbd-ec-workload}', 'rbd-import-export', 'rbd_api', 'rbd_cls', 'rbd_import_export', 'readwrite', 'rgw', 'rgw_ragweed_check}', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'test_rbd_api', 'test_rbd_python}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade:nautilus-x/parallel/{0-cluster/{openstack', 'upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack', 'upgrade:nautilus-x/stress-split/{0-cluster/{openstack'] 2021-10-16T22:40:07.743 INFO:scrape: 2021-10-16T22:40:07.744 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/test_librbd.sh 2021-10-16T22:40:07.744 INFO:scrape:1 jobs: ['6446011'] 2021-10-16T22:40:07.744 INFO:scrape:suites: ['1-ceph-install/nautilus', '1.1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{radosbench', '5-finish-upgrade', '6-octopus', '7-msgr2', '8-final-workload/{rbd-python', 'mon_election/classic', 'objectstore/bluestore-bitmap', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw_ragweed_prepare', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_18.04}', 'upgrade:nautilus-x/stress-split/{0-cluster/{openstack'] 2021-10-16T22:40:07.745 INFO:scrape: 2021-10-16T22:40:07.745 INFO:scrape:Failure: timeout expired in wait_until_healthy 2021-10-16T22:40:07.746 INFO:scrape:1 jobs: ['6446022'] 2021-10-16T22:40:07.746 INFO:scrape:suites: ['1-ceph-install/nautilus', '1.1-pg-log-overrides/short_pg_log', '2-workload/{blogbench', '3-upgrade-sequence/upgrade-mon-osd-mds', '4-octopus', '5-final-workload/{blogbench', 'ec-rados-default', 'mon_election/connectivity', 'objectstore/bluestore-bitmap', 'rados-snaps-few-objects', 'rados_api', 'rados_loadgenbig', 'rados_loadgenmix', 'rados_mon_thrash', 'rbd_cls', 'rbd_import_export', 'rgw', 'rgw_ragweed_check}', 'rgw_ragweed_prepare', 'start}', 'test_rbd_api', 'test_rbd_python}', 'ubuntu_18.04}', 'upgrade:nautilus-x/parallel/{0-cluster/{openstack'] 2021-10-16T22:40:07.747 INFO:scrape: 2021-10-16T22:40:07.749 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/ failed: 9 dead: 0 running: 0 waiting: 0 queued: 0 passed: 23 Fail ================================================================= [6446011] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 04:46:31 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446011/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446011/ sentry: https://sentry.ceph.com/organizations/ceph/?query=87e80626db194a1996e5094af156df77 Command failed (workunit test rbd/test_librbd.sh) on smithi196 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=nautilus TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh' [6446013] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:22:47 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446013/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446013/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48d1528a89d444588ac911e702228ed3 Command failed on smithi184 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [6446016] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:23:25 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446016/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446016/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fdc616e06468495bb04be57841901458 Command failed on smithi192 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [6446017] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} ----------------------------------------------------------------- time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446017/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446017/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58a434b3cb4a420ab92bbde3456f5816 Command failed on smithi166 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [6446018] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:23:23 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446018/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446018/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec7601ac0211407d91bf301dea083063 Command failed on smithi106 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [6446019] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:23:56 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446019/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446019/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f5e80adaa2744488da9593bea3be6cd Command failed on smithi149 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [6446020] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:23:18 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446020/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446020/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06ae46c5a8ee4e7e84beee4aa75500a1 Command failed on smithi146 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [6446022] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} ----------------------------------------------------------------- time: 00:21:37 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446022/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446022/ sentry: https://sentry.ceph.com/organizations/ceph/?query=78a40d78d3ce459488a1cfcffdcf543a timeout expired in wait_until_healthy [6446023] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446023/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446023/ sentry: https://sentry.ceph.com/organizations/ceph/?query=97f4f066796640cbb7e4004a68b171e4 Command failed on smithi179 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' Pass ================================================================= [6445994] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} time: 02:19:04 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6445994/ [6445995] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 02:57:44 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6445995/ [6445996] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 00:56:18 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6445996/ [6445997] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} time: 02:12:41 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6445997/ [6445998] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} time: 02:20:48 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6445998/ [6445999] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 02:46:09 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6445999/ [6446000] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 00:57:52 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446000/ [6446001] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} time: 02:14:35 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446001/ [6446002] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} time: 02:14:45 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446002/ [6446003] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04} time: 02:52:31 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446003/ [6446004] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 00:52:26 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446004/ [6446005] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} time: 02:06:44 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446005/ [6446006] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-mon-osd-mds 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} time: 02:16:49 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446006/ [6446007] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 02:36:30 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446007/ [6446008] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 00:52:53 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446008/ [6446009] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} time: 02:09:15 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446009/ [6446010] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/bluestore-bitmap ubuntu_18.04} time: 02:16:41 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446010/ [6446012] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 00:52:31 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446012/ [6446014] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/short_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/bluestore-bitmap ubuntu_18.04} time: 02:13:36 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446014/ [6446015] upgrade:nautilus-x/stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-octopus 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 03:05:13 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446015/ [6446021] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/connectivity objectstore/filestore-xfs ubuntu_18.04} time: 02:08:55 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446021/ [6446024] upgrade:nautilus-x/stress-split-erasure-code/{0-cluster/{openstack start} 1-nautilus-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-octopus 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 00:53:24 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446024/ [6446025] upgrade:nautilus-x/parallel/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1-pg-log-overrides/normal_pg_log 2-workload/{blogbench ec-rados-default rados_api rados_loadgenbig rgw_ragweed_prepare test_rbd_api test_rbd_python} 3-upgrade-sequence/upgrade-all 4-octopus 5-final-workload/{blogbench rados-snaps-few-objects rados_loadgenmix rados_mon_thrash rbd_cls rbd_import_export rgw rgw_ragweed_check} mon_election/classic objectstore/filestore-xfs ubuntu_18.04} time: 02:10:02 info: http://pulpito.ceph.com/teuthology-2021-10-16_14:23:02-upgrade:nautilus-x-pacific-distro-default-smithi/6446025/