2021-03-23T14:23:53.693 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-23T14:23:53.696 INFO:teuthology.results:subset: '8/10'
2021-03-23T14:23:53.696 INFO:teuthology.results:seed: '6166'
2021-03-23T15:19:20.953 INFO:root:teuthology version: 1.1.0-6b3150e9
2021-03-23T15:19:20.991 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-03-23T19:15:38.822 INFO:teuthology.results:Tests finished! gathering results...
2021-03-23T19:15:43.463 INFO:scrape:Found 38 jobs
2021-03-23T19:15:44.464 INFO:scrape:Found 2 distinct failure reasons
2021-03-23T19:15:44.472 INFO:scrape:Failure: timeout expired in wait_until_healthy
2021-03-23T19:15:44.472 INFO:scrape:1 jobs: ['5990573']
2021-03-23T19:15:44.473 INFO:scrape:suites: ['0-roles', '1-start', '2-first-half-tasks/rbd-import-export', '3-stress-tasks/{radosbench', '4-second-half-tasks/rbd-import-export', 'mon_election/connectivity}', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'upgrade:octopus-x/stress-split/{0-distro/centos_8.2_kubic_stable']
2021-03-23T19:15:44.474 INFO:scrape:
2021-03-23T19:15:44.474 INFO:scrape:Failure: Command failed on smithi205 with status 123: "find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --"
2021-03-23T19:15:44.475 INFO:scrape:1 jobs: ['5990565']
2021-03-23T19:15:44.476 INFO:scrape:suites: ['1-ceph-install/octopus', '1.1-pg-log-overrides/short_pg_log', '2-workload/{rgw_ragweed_prepare}', '3-upgrade-sequence/upgrade-mon-osd-mds', '4-pacific', '5-final-workload/{rgw', 'centos_latest}', 'rgw_ragweed_check}', 'start}', 'upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack']
2021-03-23T19:15:44.476 INFO:scrape:
2021-03-23T19:15:44.480 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/
failed:  2
dead:    0
running: 0
waiting: 0
queued:  0
passed:  36


Fail
=================================================================
[5990565]  upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-mon-osd-mds 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest}
-----------------------------------------------------------------
time:   00:26:11
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990565/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990565/

    Command failed on smithi205 with status 123: "find
    /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0
    --no-run-if-empty -- gzip --"

[5990573]  upgrade:octopus-x/stress-split/{0-distro/centos_8.2_kubic_stable 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
-----------------------------------------------------------------
time:   00:21:18
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990573/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990573/
sentry: https://sentry.ceph.com/organizations/ceph/?query=170ee9b288fb49ce90019d22ae5ef140

    timeout expired in wait_until_healthy



Pass
=================================================================
[5990551] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04_kubic_testing 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:27:04
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990551/

[5990552] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04_kubic_testing 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:06:49
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990552/

[5990553] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04_kubic_testing 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   02:04:35
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990553/

[5990554] upgrade:octopus-x/stress-split/{0-distro/centos_8.2_kubic_stable 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:04:44
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990554/

[5990555] upgrade:octopus-x/parallel/{0-distro/centos_8.2_kubic_stable 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:08:12
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990555/

[5990556] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-all 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest}
time:   00:19:42
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990556/

[5990557] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04}
time:   04:01:30
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990557/

[5990558] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04}
time:   04:16:25
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990558/

[5990559] upgrade:octopus-x/stress-split/{0-distro/rhel_8.3_kubic_stable 0-roles 1-start 2-first-half-tasks/rbd-import-export 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:48:22
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990559/

[5990560] upgrade:octopus-x/parallel/{0-distro/rhel_8.3_kubic_stable 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:09:55
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990560/

[5990561] upgrade:octopus-x/stress-split/{0-distro/ubuntu_18.04 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:14:46
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990561/

[5990562] upgrade:octopus-x/parallel/{0-distro/ubuntu_18.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:07:05
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990562/

[5990563] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:56:00
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990563/

[5990564] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:09:23
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990564/

[5990566] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04}
time:   01:39:28
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990566/

[5990567] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/filestore-xfs thrashosds-health ubuntu_18.04}
time:   02:38:06
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990567/

[5990568] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04_kubic_stable 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:12:04
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990568/

[5990569] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04_kubic_stable 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:05:57
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990569/

[5990570] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04_kubic_stable 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   02:07:52
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990570/

[5990571] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04_kubic_testing 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:09:11
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990571/

[5990572] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04_kubic_testing 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:07:18
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990572/

[5990574] upgrade:octopus-x/parallel/{0-distro/centos_8.2_kubic_stable 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:06:23
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990574/

[5990575] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-all 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest}
time:   00:19:22
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990575/

[5990576] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/filestore-xfs 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/classic thrashosds-health ubuntu_18.04}
time:   02:03:21
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990576/

[5990577] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/connectivity objectstore/bluestore-bitmap thrashosds-health ubuntu_18.04}
time:   04:12:16
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990577/

[5990578] upgrade:octopus-x/stress-split/{0-distro/rhel_8.3_kubic_stable 0-roles 1-start 2-first-half-tasks/rbd_api 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:14:40
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990578/

[5990579] upgrade:octopus-x/parallel/{0-distro/rhel_8.3_kubic_stable 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:09:53
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990579/

[5990580] upgrade:octopus-x/stress-split/{0-distro/ubuntu_18.04 0-roles 1-start 2-first-half-tasks/readwrite 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   01:47:14
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990580/

[5990581] upgrade:octopus-x/parallel/{0-distro/ubuntu_18.04 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:06:44
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990581/

[5990582] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/snaps-few-objects 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:18:42
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990582/

[5990583] upgrade:octopus-x/parallel/{0-distro/ubuntu_20.04 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api}}
time:   01:09:57
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990583/

[5990584] upgrade:octopus-x/parallel-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/normal_pg_log 2-workload/{rgw_ragweed_prepare} 3-upgrade-sequence/upgrade-mon-osd-mds 4-pacific 5-final-workload/{rgw rgw_ragweed_check} centos_latest}
time:   00:26:15
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990584/

[5990585] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04 0-roles 1-start 2-first-half-tasks/radosbench 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/rbd-import-export mon_election/connectivity}
time:   02:16:42
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990585/

[5990586] upgrade:octopus-x/stress-split-erasure-code-no-cephadm/{0-cluster/{openstack start} 1-nautilus-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 3.1-objectstore/bluestore-bitmap 4-ec-workload/{rados-ec-workload rbd-ec-workload} 5-finish-upgrade 6-pacific 7-final-workload mon_election/connectivity thrashosds-health ubuntu_18.04}
time:   03:37:38
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990586/

[5990587] upgrade:octopus-x/stress-split-no-cephadm/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1-pg-log-overrides/short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{radosbench rbd-cls rbd-import-export rbd_api readwrite rgw_ragweed_prepare snaps-few-objects} 5-finish-upgrade 6-pacific 7-msgr2 8-final-workload/{rbd-python snaps-many-objects} mon_election/classic objectstore/filestore-xfs thrashosds-health ubuntu_18.04}
time:   02:33:29
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990587/

[5990588] upgrade:octopus-x/stress-split/{0-distro/ubuntu_20.04_kubic_stable 0-roles 1-start 2-first-half-tasks/rbd-cls 3-stress-tasks/{radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 4-second-half-tasks/radosbench mon_election/classic}
time:   02:08:59
info:   http://pulpito.ceph.com/teuthology-2021-03-23_14:22:03-upgrade:octopus-x-pacific-distro-basic-smithi/5990588/