2020-06-04T03:36:49.967 INFO:root:teuthology version: 1.0.0-5aab241 2020-06-04T03:36:49.969 INFO:teuthology.results:seed: '3810' 2020-06-04T04:14:49.905 INFO:root:teuthology version: 1.0.0-5aab241 2020-06-04T04:14:49.944 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-06-04T05:27:51.571 INFO:teuthology.results:Tests finished! gathering results... 2020-06-04T05:27:51.705 INFO:teuthology.results:Sending results to ceph-qa@ceph.com: Test Run: teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/ failed: 31 dead: 0 running: 0 waiting: 0 queued: 0 passed: 1 Fail ================================================================= [5114435] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/centos_latest thrashosds-health} ----------------------------------------------------------------- time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114435/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114435/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=39cc9fd6427d4624853f59e5942c3bd2 Command failed on smithi093 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114436] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-lz4 supported-all-distro/rhel_7 thrashosds-health} ----------------------------------------------------------------- time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114436/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114436/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=111c58842eea414ab17774c93799d1b8 Command failed on smithi144 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114437] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-snappy supported-all-distro/ubuntu_16.04 thrashosds-health} ----------------------------------------------------------------- time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114437/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114437/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6fdddafd553b4ad2ac7b89477d4c3124 Command failed on smithi043 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114438] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zlib supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114438/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114438/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fd693457c6404f0681460ee1c3ce7dfc Command failed on smithi007 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114439] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zstd supported-all-distro/centos_latest thrashosds-health} ----------------------------------------------------------------- time: 00:14:06 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114439/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114439/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=36072b6293d54540b2bab3f1569f05e3 Command failed on smithi205 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114440] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/rhel_7 thrashosds-health} ----------------------------------------------------------------- time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114440/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114440/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=929c3869aa5b4bbd915d0c4c824e7d57 Command failed on smithi161 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114441] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_16.04 thrashosds-health} ----------------------------------------------------------------- time: 00:09:59 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114441/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114441/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=06ca936b36994285b0e952a29d3d804a Command failed on smithi045 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114442] upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade supported-all-distro/rhel_7} ----------------------------------------------------------------- time: 01:15:07 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114442/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114442/ "2020-06-04 04:38:11.551220 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi006:x (8170), after 304.532 seconds" in cluster log [5114443] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114443/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114443/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8e823c08378248ad8fb3fd3c2f261d4d Command failed on smithi186 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114444] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-lz4 supported-all-distro/centos_latest thrashosds-health} ----------------------------------------------------------------- time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114444/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114444/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=68ff4c01fb4241d5b766da673a29b8f5 Command failed on smithi013 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114445] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-snappy supported-all-distro/rhel_7 thrashosds-health} ----------------------------------------------------------------- time: 00:15:48 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114445/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114445/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d3046109e563440bb9ca07b4a9702fb4 Command failed on smithi174 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114446] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zlib supported-all-distro/ubuntu_16.04 thrashosds-health} ----------------------------------------------------------------- time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114446/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114446/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=dfb41465044346ce8881562181bdcb74 Command failed on smithi122 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114447] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zstd supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114447/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114447/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0bb713b0c9654a5a9a8472d041866739 Command failed on smithi105 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114448] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/centos_latest thrashosds-health} ----------------------------------------------------------------- time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114448/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114448/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3cbfcde6f749497d85c429177aa53421 Command failed on smithi171 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114449] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/filestore-xfs supported-all-distro/rhel_7 thrashosds-health} ----------------------------------------------------------------- time: 00:16:45 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114449/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114449/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f667537d7144455f9a8c5b26304b9f76 Command failed on smithi152 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114450] upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_16.04} ----------------------------------------------------------------- time: 01:09:27 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114450/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114450/ "2020-06-04 04:38:40.320092 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi005:x (6260), after 302.337 seconds" in cluster log [5114451] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/ubuntu_16.04 thrashosds-health} ----------------------------------------------------------------- time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114451/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114451/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=83503b5aefe744b990441b4a3f17e3ed Command failed on smithi124 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114452] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-lz4 supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114452/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114452/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=06896591339345018024b16dd25a7d81 Command failed on smithi018 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114453] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-snappy supported-all-distro/centos_latest thrashosds-health} ----------------------------------------------------------------- time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114453/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114453/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=646ea621b7f041e58aa960ee298bfcce Command failed on smithi144 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114454] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zlib supported-all-distro/rhel_7 thrashosds-health} ----------------------------------------------------------------- time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114454/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114454/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=99d22b46cd96480a89384e6b9a3fbb94 Command failed on smithi131 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114455] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zstd supported-all-distro/ubuntu_16.04 thrashosds-health} ----------------------------------------------------------------- time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114455/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114455/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6768caa8f71243fbab1cca42e20bb3f3 Command failed on smithi106 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114456] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114456/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114456/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7d53af6c455d41f7b699b554bdc719d7 Command failed on smithi093 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114457] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/filestore-xfs supported-all-distro/centos_latest thrashosds-health} ----------------------------------------------------------------- time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114457/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114457/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=43f62dcc0c5c47a8ba421a3007ca84eb Command failed on smithi186 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114458] upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade supported-all-distro/ubuntu_latest} ----------------------------------------------------------------- time: 01:10:14 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114458/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114458/ "2020-06-04 04:45:31.477857 mds.a (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi049:x (7662), after 304.364 seconds" in cluster log [5114459] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-bitmap supported-all-distro/rhel_7 thrashosds-health} ----------------------------------------------------------------- time: 00:16:58 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114459/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114459/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c86caf1e59bd449baa3d407e5ac7cdc2 Command failed on smithi032 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114460] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-lz4 supported-all-distro/ubuntu_16.04 thrashosds-health} ----------------------------------------------------------------- time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114460/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114460/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=04dfde9bde6642dfa17e2b7a182a4904 Command failed on smithi001 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114461] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-snappy supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114461/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114461/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2918b495e15949498e3854567ac68077 Command failed on smithi161 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114462] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zlib supported-all-distro/centos_latest thrashosds-health} ----------------------------------------------------------------- time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114462/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114462/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bcf19ca5b2cf466988bb40ee0e966883 Command failed on smithi045 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114463] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-comp-zstd supported-all-distro/rhel_7 thrashosds-health} ----------------------------------------------------------------- time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114463/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114463/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6351537d27084b9c8fe39d1ff4e32efb Command failed on smithi058 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114464] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/bluestore-stupid supported-all-distro/ubuntu_16.04 thrashosds-health} ----------------------------------------------------------------- time: 00:10:25 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114464/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114464/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ad2b1cf85a3346bab75b5bd7ec560fad Command failed on smithi031 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" [5114465] upgrade:nautilus-p2p/nautilus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/nautilus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 7-final-workload/{rbd-python rgw-swift snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health} ----------------------------------------------------------------- time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114465/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114465/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a3f1d05c0e7c4ee5aa75b58239bef074 Command failed on smithi013 with status 1: "/bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to- stderr --name client.0 -b 65536 -O 65536 -p unique_pool_0 bench 90 write'" Pass ================================================================= [5114434] upgrade:nautilus-p2p/nautilus-p2p-parallel/{point-to-point-upgrade supported-all-distro/centos_latest} time: 01:11:44 info: http://pulpito.ceph.com/teuthology-2020-06-02_19:27:53-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/5114434/