2022-06-18T14:22:30.130 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0 2022-06-18T14:22:30.132 INFO:teuthology.results:subset: '1/10' 2022-06-18T14:22:30.132 INFO:teuthology.results:seed: '1910' 2022-06-18T17:38:14.642 INFO:root:teuthology version: 1.1.1.dev374+g31a356e0 2022-06-18T17:38:14.658 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-18T22:48:40.795 INFO:teuthology.results:Tests finished! gathering results... 2022-06-18T22:48:44.232 INFO:scrape:Found 34 jobs 2022-06-18T22:48:44.233 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885237/teuthology.log 2022-06-18T22:48:44.234 INFO:scrape:Found 1 distinct failure reasons 2022-06-18T22:48:44.234 INFO:scrape:Dead: None 2022-06-18T22:48:44.235 INFO:scrape:1 jobs: ['6885237'] 2022-06-18T22:48:44.236 INFO:scrape: 2022-06-18T22:48:44.237 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/ failed: 0 dead: 1 running: 0 waiting: 0 queued: 0 passed: 33 Dead ================================================================= [6885237] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885237/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885237/ Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds Pass ================================================================= [6885223] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:48 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885223/ [6885224] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-all 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:22:24 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885224/ [6885225] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:22:58 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885225/ [6885226] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 04:08:42 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885226/ [6885227] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_18.04} time: 04:58:34 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885227/ [6885228] upgrade:octopus-x/stress-split/{0-distro/ubuntu_18.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:00:04 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885228/ [6885229] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:17:23 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885229/ [6885230] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:09:17 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885230/ [6885231] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:03 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885231/ [6885232] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-mon-osd-mds 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:28:35 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885232/ [6885233] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:00:40 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885233/ [6885235] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 01:56:00 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885235/ [6885239] upgrade:octopus-x/parallel/{0-distro/ubuntu_18.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:09:04 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885239/ [6885241] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:22:35 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885241/ [6885243] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:10:45 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885243/ [6885245] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:05:23 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885245/ [6885247] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:03:58 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885247/ [6885249] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-all 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:22:05 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885249/ [6885251] upgrade:octopus-x/stress-split/{0-distro/ubuntu_18.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:19:29 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885251/ [6885253] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 01:25:31 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885253/ [6885255] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_18.04} time: 05:11:48 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885255/ [6885258] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:08:37 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885258/ [6885260] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:18:46 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885260/ [6885262] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 01:57:12 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885262/ [6885264] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:22 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885264/ [6885266] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-mon-osd-mds 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:28:02 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885266/ [6885268] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:08:05 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885268/ [6885269] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 04:52:46 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885269/ [6885272] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 02:47:34 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885272/ [6885274] upgrade:octopus-x/parallel/{0-distro/ubuntu_18.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:31 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885274/ [6885276] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic} time: 02:05:26 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885276/ [6885278] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:09:02 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885278/ [6885280] upgrade:octopus-x/stress-split/{0-distro/ubuntu_18.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity} time: 02:06:11 info: http://pulpito.ceph.com/teuthology-2022-06-18_14:22:02-upgrade:octopus-x-pacific-distro-default-smithi/6885280/