2022-04-30T12:09:12.709 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-04-30T12:09:12.710 INFO:teuthology.results:subset: '111/120000' 2022-04-30T12:09:12.710 INFO:teuthology.results:seed: '8259' 2022-04-30T12:44:41.529 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-04-30T12:44:41.568 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-30T19:34:11.857 INFO:teuthology.results:Tests finished! gathering results... 2022-04-30T19:34:15.039 INFO:scrape:Found 29 jobs 2022-04-30T19:34:15.060 INFO:scrape:Found 1 distinct failure reasons 2022-04-30T19:34:15.061 INFO:scrape:Dead: b'2022-04-30T19:07:27.469 DEBUG:teuthology.exit:Finished running handlers' 2022-04-30T19:34:15.061 INFO:scrape:1 jobs: ['6815974'] 2022-04-30T19:34:15.061 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/radosbench', '3-stress-tasks/{radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/classic}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0'] 2022-04-30T19:34:15.062 INFO:scrape: 2022-04-30T19:34:15.065 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/ failed: 0 dead: 1 running: 0 waiting: 0 queued: 0 passed: 28 Dead ================================================================= [6815974] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_3.0 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815974/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815974/ hit max job timeout Pass ================================================================= [6815950] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-mon-osd-mds 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:27:43 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815950/ [6815951] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 04:18:59 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815951/ [6815952] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 02:40:45 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815952/ [6815953] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:14:31 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815953/ [6815954] upgrade:octopus-x/parallel/{0-distro/ubuntu_18.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:06:51 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815954/ [6815955] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:09:51 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815955/ [6815956] upgrade:octopus-x/stress-split/{0-distro/ubuntu_18.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:07:16 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815956/ [6815957] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:04:14 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815957/ [6815958] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-all 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:21:46 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815958/ [6815959] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-hybrid 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 04:24:35 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815959/ [6815960] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-hybrid thrashosds-health ubuntu_18.04} time: 04:59:03 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815960/ [6815961] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 01:59:54 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815961/ [6815962] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:50 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815962/ [6815963] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:15:07 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815963/ [6815964] upgrade:octopus-x/stress-split/{0-distro/centos_8.stream_container_tools 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:05:30 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815964/ [6815966] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-mon-osd-mds 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:27:09 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815966/ [6815968] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04} time: 01:47:35 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815968/ [6815970] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04} time: 02:39:14 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815970/ [6815972] upgrade:octopus-x/parallel/{0-distro/ubuntu_18.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:07:47 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815972/ [6815976] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:10:36 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815976/ [6815978] upgrade:octopus-x/stress-split/{0-distro/rhel_8.4_container_tools_rhel8 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/connectivity} time: 02:17:40 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815978/ [6815980] upgrade:octopus-x/parallel/{0-distro/centos_8.stream_container_tools 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:03:55 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815980/ [6815982] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-all 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest} time: 00:21:31 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815982/ [6815984] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-octopus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04} time: 01:26:28 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815984/ [6815986] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-hybrid thrashosds-health ubuntu_18.04} time: 04:43:30 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815986/ [6815988] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_3.0 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:16:07 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815988/ [6815990] upgrade:octopus-x/stress-split/{0-distro/ubuntu_18.04 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/classic} time: 02:00:27 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815990/ [6815992] upgrade:octopus-x/parallel/{0-distro/rhel_8.4_container_tools_rhel8 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}} time: 01:13:33 info: http://pulpito.ceph.com/yuriw-2022-04-30_04:13:00-upgrade:octopus-x-wip-yuri4-testing-2022-04-29-1830-pacific-distro-default-smithi/6815992/