2021-08-16T18:32:58.759 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-16T18:32:58.760 INFO:teuthology.results:seed: '2977' 2021-08-16T18:55:56.872 INFO:root:teuthology version: 1.1.0-321319b1 2021-08-16T18:55:56.904 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-08-17T01:06:24.396 INFO:teuthology.results:Tests finished! gathering results... 2021-08-17T01:06:25.558 INFO:scrape:Found 5 jobs 2021-08-17T01:06:27.042 INFO:scrape:Found 2 distinct failure reasons 2021-08-17T01:06:27.043 INFO:scrape:Failure: "2021-08-16T19:00:00.000165+0000 mon.a (mon.0) 1199 : cluster [WRN] overall HEALTH_WARN Degraded data redundancy: 59/312 objects degraded (18.910%), 16 pgs degraded" in cluster log 2021-08-17T01:06:27.043 INFO:scrape:1 jobs: ['6325996'] 2021-08-17T01:06:27.043 INFO:scrape:suites: ['supported-all-distro/ubuntu_latest}', 'upgrade:pacific-p2p/pacific-p2p-parallel/{point-to-point-upgrade'] 2021-08-17T01:06:27.044 INFO:scrape: 2021-08-17T01:06:27.044 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json 2021-08-17T01:06:27.045 INFO:scrape:1 jobs: ['6326000'] 2021-08-17T01:06:27.045 INFO:scrape:suites: ['1-ceph-install/pacific.', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '6-final-workload/{rbd-python', 'objectstore/filestore-xfs', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack'] 2021-08-17T01:06:27.046 INFO:scrape: 2021-08-17T01:06:27.047 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 3 Fail ================================================================= [6325996] upgrade:pacific-p2p/pacific-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_latest} ----------------------------------------------------------------- time: 01:13:43 info: http://pulpito.ceph.com/teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/6325996/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/6325996/ "2021-08-16T19:00:00.000165+0000 mon.a (mon.0) 1199 : cluster [WRN] overall HEALTH_WARN Degraded data redundancy: 59/312 objects degraded (18.910%), 16 pgs degraded" in cluster log [6326000] upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/pacific. 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 01:33:24 info: http://pulpito.ceph.com/teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/6326000/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/6326000/ sentry: https://sentry.ceph.com/organizations/ceph/?query=320fc1debaff4ef6afe4fa6984bd70f1 Command failed on smithi003 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' Pass ================================================================= [6325997] upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/pacific. 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} time: 06:22:07 info: http://pulpito.ceph.com/teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/6325997/ [6325998] upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/pacific. 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-comp supported-all-distro/ubuntu_latest thrashosds-health} time: 04:30:39 info: http://pulpito.ceph.com/teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/6325998/ [6325999] upgrade:pacific-p2p/pacific-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/pacific. 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health} time: 05:30:07 info: http://pulpito.ceph.com/teuthology-2021-08-08_01:25:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/6325999/