2020-10-31T23:40:08.232 INFO:root:teuthology version: 1.0.0-f7de558 2020-10-31T23:40:08.234 INFO:teuthology.results:seed: '1399' 2020-10-31T23:48:40.887 INFO:root:teuthology version: 1.0.0-f7de558 2020-10-31T23:48:40.954 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-01T04:59:46.597 INFO:teuthology.results:Tests finished! gathering results... 2020-11-01T04:59:49.168 INFO:scrape:Found 16 jobs 2020-11-01T04:59:50.178 INFO:scrape:Found 2 distinct failure reasons 2020-11-01T04:59:50.179 INFO:scrape:Failure: timed out waiting for admin_socket to appear after osd.1 restart 2020-11-01T04:59:50.179 INFO:scrape:2 jobs: ['5569547', '5569555'] 2020-11-01T04:59:50.180 INFO:scrape:suites intersection: ['1-ceph-install/nautilus', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '7-final-workload/{rbd-python', 'objectstore/default', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw-swift', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health}', 'upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack'] 2020-11-01T04:59:50.180 INFO:scrape:suites union: ['1-ceph-install/nautilus', '1.1.short_pg_log', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{fsx', '5-finish-upgrade', '7-final-workload/{rbd-python', 'objectstore/default', 'radosbench', 'rbd-cls', 'rbd-import-export', 'rbd_api', 'readwrite', 'rgw-swift', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'supported-all-distro/rhel_7', 'supported-all-distro/ubuntu_latest', 'thrashosds-health}', 'upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack'] 2020-11-01T04:59:50.181 INFO:scrape: 2020-11-01T04:59:50.181 INFO:scrape:Failure: "2020-11-01 00:28:22.739802 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi093:x (7824), after 304.314 seconds" in cluster log 2020-11-01T04:59:50.182 INFO:scrape:1 jobs: ['5569557'] 2020-11-01T04:59:50.182 INFO:scrape:suites: ['supported-all-distro/ubuntu_latest}', 'upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade'] 2020-11-01T04:59:50.183 INFO:scrape: 2020-11-01T04:59:50.184 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 13 Fail ================================================================= [5569547] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/default supported-all-distro/rhel_7 thrashosds-health} ----------------------------------------------------------------- time: 02:38:27 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569547/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569547/ sentry: https://sentry.ceph.com/ceph/sepia/?query=ca09a9249c4b4abdbfd400a326707d5b timed out waiting for admin_socket to appear after osd.1 restart [5569555] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/default supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 02:39:11 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569555/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569555/ sentry: https://sentry.ceph.com/ceph/sepia/?query=9afb574363504a9b81386632b5265bb3 timed out waiting for admin_socket to appear after osd.2 restart [5569557] upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_latest} ----------------------------------------------------------------- time: 01:08:13 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569557/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569557/ "2020-11-01 00:28:22.739802 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi093:x (7824), after 304.314 seconds" in cluster log Pass ================================================================= [5569544] upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade supported-all-distro/centos_latest} time: 01:13:26 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569544/ [5569546] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/centos_latest thrashosds-health} time: 03:57:11 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569546/ [5569548] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_16.04 thrashosds-health} time: 03:07:26 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569548/ [5569549] upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade supported-all-distro/rhel_7} time: 01:14:17 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569549/ [5569550] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} time: 03:58:40 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569550/ [5569551] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/default supported-all-distro/centos_latest thrashosds-health} time: 03:25:14 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569551/ [5569552] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/filestore-xfs supported-all-distro/rhel_7 thrashosds-health} time: 03:14:31 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569552/ [5569553] upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_16.04} time: 01:08:42 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569553/ [5569554] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_16.04 thrashosds-health} time: 03:48:29 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569554/ [5569556] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/filestore-xfs supported-all-distro/centos_latest thrashosds-health} time: 03:27:14 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569556/ [5569558] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/rhel_7 thrashosds-health} time: 03:52:29 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569558/ [5569559] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/default supported-all-distro/ubuntu_16.04 thrashosds-health} time: 03:16:17 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569559/ [5569560] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} time: 03:15:35 info: http://pulpito.ceph.com/teuthology-2020-10-29_01:25:02-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5569560/