2020-07-05T09:16:31.262 INFO:root:teuthology version: 1.0.0-2b31d02 2020-07-05T09:16:31.263 INFO:teuthology.results:subset: '27/9999' 2020-07-05T09:16:31.263 INFO:teuthology.results:seed: '1903' 2020-07-05T11:10:50.854 INFO:root:teuthology version: 1.0.0-2b31d02 2020-07-05T11:10:50.882 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-05T16:10:59.961 INFO:teuthology.results:Tests finished! gathering results... 2020-07-05T16:11:19.449 INFO:scrape:Found 308 jobs 2020-07-05T16:11:51.794 INFO:scrape:Found 9 distinct failure reasons 2020-07-05T16:11:51.796 INFO:scrape:Failure: Command failed on smithi097 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' 2020-07-05T16:11:51.796 INFO:scrape:81 jobs 2020-07-05T16:11:51.797 INFO:scrape:suites intersection: [] 2020-07-05T16:11:51.798 INFO:scrape:suites union: ['1-install/nautilus', '1-pg-log-overrides/normal_pg_log', '2-partial-upgrade/firsthalf', '2-recovery-overrides/{more-active-recovery}', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'backoff/normal', 'bluestore-bitmap', 'ceph', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'd-balancer/crush-compat', 'd-thrash/default/{default', 'd-thrash/none', 'debug/mgr', 'fixed-2', 'mode/packaged', 'mode/root', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/with-work/{distro/centos_8.0', 'rados/cephadm/with-work/{distro/centos_latest', 'rados/cephadm/with-work/{distro/rhel_8.0', 'rados/cephadm/with-work/{distro/rhel_latest', 'rados/cephadm/with-work/{distro/ubuntu_18.04', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/objectstore/{backends/alloc-hint', 'rados/objectstore/{backends/fusestore', 'rados/objectstore/{backends/objectcacher-stress', 'rados/rest/{mgr-restful', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/balancer', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/pool-access', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/deduptool', 'rados/singleton/{all/erasure-code-nonregression', 'rados/singleton/{all/mon-auth-caps', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-key-caps', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/radostool', 'rados/singleton/{all/test-crash', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/standalone/{supported-random-distro$/{centos_8}', 'rados/standalone/{supported-random-distro$/{rhel_8}', 'rados/standalone/{supported-random-distro$/{ubuntu_latest}', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rados/verify/{centos_latest', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start', 'start}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'task/test_adoption}', 'task/test_cephadm_repos}', 'task/test_cephadm}', 'tasks/rados_api_tests', 'tasks/rados_api_tests}', 'tasks/rados_cls_all', 'tasks/rados_cls_all}', 'tasks/rados_python}', 'tasks/rados_stress_watch}', 'tasks/rados_workunit_loadgen_big}', 'tasks/rados_workunit_loadgen_mix}', 'tasks/rados_workunit_loadgen_mostlyread}', 'tasks/workunits}', 'thrashers/force-sync-many', 'thrashers/one', 'thrashers/pggrow', 'thrashers/sync', 'thrashers/sync-many', 'thrashosds-health', 'thrashosds-health}', 'ubuntu_latest}', 'validater/lockdep}', 'validater/valgrind}', 'workloads/crush}', 'workloads/erasure-code}', 'workloads/mgr}', 'workloads/misc}', 'workloads/mon}', 'workloads/osd}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/rados_mon_workunits}', 'workloads/scrub}'] 2020-07-05T16:11:51.798 INFO:scrape: 2020-07-05T16:11:51.799 INFO:scrape:Crash: Command crashed: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir $TESTDIR/kvtest && cd $TESTDIR/kvtest && ceph_test_keyvaluedb'" 2020-07-05T16:11:51.799 INFO:scrape:ceph version 16.0.0-2962-g5ccfc2d5d3 (5ccfc2d5d3a03d700cf9c4a48b194d7836328981) pacific (dev) 1: (()+0x12890) [0x7f53ee27e890] 2: (gsignal()+0xc7) [0x7f53e35aae97] 3: (abort()+0x141) [0x7f53e35ac801] 4: (()+0x3039a) [0x7f53e359c39a] 5: (()+0x30412) [0x7f53e359c412] 6: (rocksdb::ColumnFamilySet::~ColumnFamilySet()+0x91) [0x555a5f6dbfcf] 7: (std::default_delete::operator()(rocksdb::ColumnFamilySet*) const+0x22) [0x555a5f52074c] 8: (std::unique_ptr >::reset(rocksdb::ColumnFamilySet*)+0x55) [0x555a5f51ac73] 9: (rocksdb::VersionSet::~VersionSet()+0x5e) [0x555a5f4ffb00] 10: (rocksdb::VersionSet::~VersionSet()+0x18) [0x555a5f4ffc88] 11: (std::default_delete::operator()(rocksdb::VersionSet*) const+0x2e) [0x555a5f3a5f22] 12: (std::unique_ptr >::reset(rocksdb::VersionSet*)+0x55) [0x555a5f3985c1] 13: (rocksdb::DBImpl::CloseHelper()+0xaaa) [0x555a5f361b82] 14: (rocksdb::DBImpl::~DBImpl()+0x5d) [0x555a5f36200b] 15: (rocksdb::DBImpl::~DBImpl()+0x18) [0x555a5f3623ce] 16: (RocksDBStore::close()+0x31a) [0x555a5f333faa] 17: (RocksDBStore::reshard(std::__cxx11::basic_string, std::allocator > const&, RocksDBStore::resharding_ctrl const*)+0x31e) [0x555a5f33abfe] 18: (RocksDBResharding_change_reshard_Test::TestBody()+0x15a) [0x555a5f2acc6a] 19: (void testing::internal::HandleExceptionsInMethodIfSupported(testing::Test*, void (testing::Test::*)(), char const*)+0x4a) [0x555a5f2f5bca] 20: (testing::Test::Run()+0xc3) [0x555a5f2eb843] 21: (testing::TestInfo::Run()+0x135) [0x555a5f2eb9a5] 22: (testing::TestSuite::Run()+0xb5) [0x555a5f2eba85] 23: (testing::internal::UnitTestImpl::RunAllTests()+0x478) [0x555a5f2ebf98] 24: (bool testing::internal::HandleExceptionsInMethodIfSupported(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*)+0x4a) [0x555a5f2f60da] 25: (testing::UnitTest::Run()+0x98) [0x555a5f2ec1a8] 26: (main()+0x152) [0x555a5f2969e2] 27: (__libc_start_main()+0xe7) [0x7f53e358db97] 28: (_start()+0x2a) [0x555a5f2994ca] 2020-07-05T16:11:51.800 INFO:scrape:1 jobs: ['5199781'] 2020-07-05T16:11:51.800 INFO:scrape:suites: ['rados/objectstore/{backends/keyvaluedb', 'supported-random-distro$/{ubuntu_latest}}'] 2020-07-05T16:11:51.801 INFO:scrape: 2020-07-05T16:11:51.801 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-07-05T16:11:51.801 INFO:scrape:8 jobs: ['5199720', '5199847', '5199603', '5199751', '5199740', '5199818', '5199593', '5199655'] 2020-07-05T16:11:51.802 INFO:scrape:suites intersection: [] 2020-07-05T16:11:51.802 INFO:scrape:suites union: ['1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/nautilus', '1-install/nautilus-v2only', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{centos_7.6}', 'fixed-2', 'mode/root', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'rados', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'start', 'tasks/rados_api_tests}', 'thrashers/careful', 'thrashers/default', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/test_rbd_api}'] 2020-07-05T16:11:51.803 INFO:scrape: 2020-07-05T16:11:51.803 INFO:scrape:Failure: wait_for_recovery: failed before timeout expired 2020-07-05T16:11:51.804 INFO:scrape:1 jobs: ['5199624'] 2020-07-05T16:11:51.804 INFO:scrape:suites: ['1-install/mimic-v1only', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{centos_7.6}', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'thrashers/careful', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2020-07-05T16:11:51.804 INFO:scrape: 2020-07-05T16:11:51.805 INFO:scrape:Failure: Command failed on smithi187 with status 100: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo apt -y install podman'" 2020-07-05T16:11:51.805 INFO:scrape:1 jobs: ['5199761'] 2020-07-05T16:11:51.806 INFO:scrape:suites: ['rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2020-07-05T16:11:51.806 INFO:scrape: 2020-07-05T16:11:51.806 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean. 2020-07-05T16:11:51.807 INFO:scrape:4 jobs: ['5199725', '5199806', '5199793', '5199796'] 2020-07-05T16:11:51.807 INFO:scrape:suites intersection: ['rados'] 2020-07-05T16:11:51.808 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/3-mons', 'clusters/{fixed-2', 'd-balancer/on', 'd-thrash/default/{default', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/monthrash/{ceph', 'rados/singleton-nomsgr/{all/multi-backfill-reject', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rados_api_tests', 'thrashers/many', 'thrashers/none', 'thrashosds-health', 'thrashosds-health}', 'validater/valgrind}', 'workloads/pool-create-delete}', 'workloads/pool-snaps-few-objects}'] 2020-07-05T16:11:51.808 INFO:scrape: 2020-07-05T16:11:51.808 INFO:scrape:Failure: Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) 2020-07-05T16:11:51.809 INFO:scrape:4 jobs: ['5199726', '5199650', '5199802', '5199567'] 2020-07-05T16:11:51.809 INFO:scrape:suites intersection: ['task/test_orch_cli}'] 2020-07-05T16:11:51.810 INFO:scrape:suites union: ['rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_orch_cli}'] 2020-07-05T16:11:51.810 INFO:scrape: 2020-07-05T16:11:51.810 INFO:scrape:Failure: '/home/ubuntu/cephtest/archive/syslog/misc.log:2020-07-05T11:27:33.235365+00:00 smithi133 bash[12421]: debug 2020-07-05T11:27:33.228+0000 7f18cf821700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:/usr/bin/podman:stderr Error: container_linux.go:349: starting container process caused "exec: \"/usr/sbin/ceph-volume\": stat /usr/sbin/ceph-volume: no such file or directory": OCI runtime command not found error ' in syslog 2020-07-05T16:11:51.811 INFO:scrape:1 jobs: ['5199855'] 2020-07-05T16:11:51.811 INFO:scrape:suites: ['rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman', 'start}'] 2020-07-05T16:11:51.812 INFO:scrape: 2020-07-05T16:11:51.812 INFO:scrape:Failure: "2020-07-05T11:13:18.546056+0000 mon.a (mon.0) 127 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 2020-07-05T16:11:51.812 INFO:scrape:1 jobs: ['5199828'] 2020-07-05T16:11:51.813 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'validater/lockdep}'] 2020-07-05T16:11:51.813 INFO:scrape: 2020-07-05T16:11:51.826 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/ failed: 101 dead: 1 running: 0 waiting: 0 queued: 0 passed: 206 Fail ================================================================= [5199567] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} ----------------------------------------------------------------- time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199567/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199567/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fd157cad1e704e5799b6fe81f41f2614 Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5199572] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:21:28 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199572/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199572/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f693a656031e4a959e29faa3bacdf44a Command failed on smithi133 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199574] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199574/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199574/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=06b66fcb79454613b59cd81646dd8c00 Command failed on smithi185 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199575] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199575/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199575/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d7f78747b08a4966beb840139c490bd2 Command failed on smithi119 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.a && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.a && cd /home/ubuntu/cephtest/clone.client.a && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199577] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} ----------------------------------------------------------------- time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199577/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199577/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f2070d8f3072429cb93bba97bcbe6197 Command failed on smithi001 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199578] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 03:36:17 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199578/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199578/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6b514c09b2874240b230deb29fdef827 Command failed on smithi061 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199585] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199585/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199585/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0d6f3fdeb6944ce5ada590d5b355306f Command failed on smithi192 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199589] rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:04 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199589/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199589/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=93ca82e3ec2f44dc8e84acdae5b68792 Command failed on smithi018 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199593] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:25:52 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199593/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199593/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7126d451fc0e47eb996674aebeb2d9b0 reached maximum tries (180) after waiting for 180 seconds [5199597] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199597/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199597/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d498f72365d542c69e9f68a4888825f6 Command failed on smithi112 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199600] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} ----------------------------------------------------------------- time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199600/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199600/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=968de89c14dd4594b85c7674e6e82c22 Command failed on smithi006 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199601] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199601/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199601/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f2db2f0f7e334a358cb13cb85f53d70d Command failed on smithi103 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199603] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:24:29 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199603/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199603/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b42a3341e9894f4c8c47a4de16ba7650 reached maximum tries (180) after waiting for 180 seconds [5199607] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199607/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199607/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cce4f7d037b340aba76a77d64bd69b84 Command failed on smithi095 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199608] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} ----------------------------------------------------------------- time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199608/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199608/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=098e1614acfc4590859be01de209ad7f Command failed on smithi089 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199610] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:16:00 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199610/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199610/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a273393f7a90446b97c3194eeec79a01 Command failed on smithi041 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199614] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 00:26:48 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199614/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199614/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4ba2573381b3460aa3c2d082a6ebeaf1 Command failed on smithi124 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199623] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} ----------------------------------------------------------------- time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199623/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199623/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=981da32301164f14a4a7d50335e0e7fc Command failed on smithi018 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199624] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 02:58:28 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199624/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199624/ wait_for_recovery: failed before timeout expired [5199627] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199627/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199627/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f19e9d25d2e444cbad9cec2b8531bf35 Command failed on smithi085 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199630] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199630/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199630/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6d5de27cd8c34cf5b9540a16b04f3d6b Command failed on smithi158 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199632] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199632/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199632/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=164aca772afb4a9182224e861b3f9f80 Command failed on smithi181 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199633] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:12:55 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199633/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199633/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fc0dd96b0cb54bcfa9fe882bfd24c5e4 Command failed on smithi064 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199635] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199635/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199635/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5dbac52d262a4d0ea83bf3bb1dccb4ba Command failed on smithi047 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199640] rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199640/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199640/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f45ec55536594ca2ae49dca26fbca41c Command failed on smithi069 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199641] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:18:54 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199641/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199641/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cb4b5493078546b18dd382da4b523826 Command failed on smithi195 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199650] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199650/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199650/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6afa1a6dc5e44c959b46575ac8219d86 Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5199651] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/workunits} ----------------------------------------------------------------- time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199651/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199651/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a83155946e364550976d6bd865f6d1ba Command failed on smithi052 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199652] rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199652/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199652/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d16832427c8440ca9e9a609cd84f4347 Command failed on smithi074 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199653] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199653/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199653/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5e6a1f8d45b449208ecf725a03c0568e Command failed on smithi103 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199655] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:24:10 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199655/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199655/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bda9558a472344ed83ffc48182287723 reached maximum tries (180) after waiting for 180 seconds [5199658] rados/singleton/{all/mon-config-keys msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199658/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199658/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=55a13458938c4da68b4910ba78648c4c Command failed on smithi125 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199661] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_python} ----------------------------------------------------------------- time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199661/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199661/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0ebb77099ed7413b9012e0cb1c68a0c8 Command failed on smithi158 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199662] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:25:39 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199662/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199662/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=be59f4ea2cd4497197ba08da2735df3f Command failed on smithi032 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199663] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199663/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199663/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=690eecef114b4031908c54293c291ffe Command failed on smithi050 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199664] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} ----------------------------------------------------------------- time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199664/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199664/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=624234b402bd4f209a2ada6470adfdb9 Command failed on smithi018 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199665] rados/singleton/{all/mon-config msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199665/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199665/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=880693b60d944b5eae4cf4c2cf6817bd Command failed on smithi041 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199666] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} ----------------------------------------------------------------- time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199666/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199666/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9654b55f5c1e43a2b0e535aacb9d49f1 Command failed on smithi095 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199673] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:28:48 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199673/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199673/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4e1e50345f1a4b83b06315b152600f51 Command failed on smithi045 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199680] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:16:02 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199680/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199680/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=78ffed30d0ae4d0581056273d3b31640 Command failed on smithi083 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199684] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:23:58 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199684/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199684/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e8e4ee5d1cab42baad57ce251cfae0bb Command failed on smithi058 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199686] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} ----------------------------------------------------------------- time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199686/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199686/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9e10cfee9e25439aabde5e4abe307fa1 Command failed on smithi122 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199689] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} ----------------------------------------------------------------- time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199689/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199689/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=123c44b7c09c46c8a3de1667478a50d1 Command failed on smithi035 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199701] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:21:39 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199701/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199701/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4b0195846ad34472b22c8aeac18e6ee3 Command failed on smithi074 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199704] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199704/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199704/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b2dea02fda3242aeb173ed5f854580d4 Command failed on smithi089 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199706] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199706/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199706/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e26da92540ec4706be60f5983f295322 Command failed on smithi028 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199707] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199707/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199707/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=30e1f31abbb74d66bc16b37a9203f12c Command failed on smithi110 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199711] rados/singleton/{all/pg-autoscaler msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199711/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199711/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=43a7e05fc5a349878262eb4218291e0b Command failed on smithi016 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199712] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} ----------------------------------------------------------------- time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199712/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199712/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5c1b63a0fda7406297efa5f231b7c4e2 Command failed on smithi099 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199714] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:22:10 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199714/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199714/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a839cfdf499242a982c561e1e87e2037 Command failed on smithi103 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199720] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:24:30 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199720/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199720/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4d2c0e29c0c6443fb997de6808085d60 reached maximum tries (180) after waiting for 180 seconds [5199724] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199724/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199724/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5752ebeb4eed4e08adbef57f635d3c85 Command failed on smithi018 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199725] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/many workloads/pool-create-delete} ----------------------------------------------------------------- time: 00:41:38 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199725/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199725/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=014d7fc04f2047c2aa154fa58392c025 Scrubbing terminated -- not all pgs were active and clean. [5199726] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} ----------------------------------------------------------------- time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199726/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199726/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=144b6cabe8ef4609bb3680fa2e914b1e Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5199727] rados/singleton/{all/radostool msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199727/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199727/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=08d4142821ed4a6eb696a56fd0dc06cb Command failed on smithi095 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199731] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199731/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199731/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bd56e16b3ed94d3c9816f08a47e59166 Command failed on smithi044 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199733] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} ----------------------------------------------------------------- time: 00:12:56 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199733/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199733/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0b86ecf11cdd481a90cd5213db4a087c Command failed on smithi174 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199735] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 00:27:00 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199735/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199735/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=368e0a6291cb4db8b1c756a529aaf49c Command failed on smithi047 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199746] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:50 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199746/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199746/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c521e6c6486b4aa8adeaff0155e9ebc9 Command failed on smithi155 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199749] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199749/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199749/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b5182b23a8414560a63d35cda92d4ecc Command failed on smithi110 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199751] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:25:20 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199751/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199751/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=16c7a9aa7e4e4392a7623aa6790cca64 reached maximum tries (180) after waiting for 180 seconds [5199755] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} ----------------------------------------------------------------- time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199755/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199755/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=06b3f2b010ae4ec4b45b17f3915e7195 Command failed on smithi124 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199757] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} ----------------------------------------------------------------- time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199757/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199757/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e570c762a1d1449c97ec74a312b20ac3 Command failed on smithi154 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199758] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199758/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199758/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=31e812a5489a445b965c01553cc35ebd Command failed on smithi145 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199760] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} ----------------------------------------------------------------- time: 00:16:11 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199760/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199760/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a8d4f85dbe2b4494966fa19d56b64fd4 Command failed on smithi118 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199761] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} ----------------------------------------------------------------- time: 00:03:15 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199761/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199761/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e4936e0e2a474cba947e2834184c85e6 Command failed on smithi187 with status 100: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo apt -y install podman'" [5199768] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199768/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199768/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=35a7edc93a3b4b5e963cb51fbfa82963 Command failed on smithi137 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199771] rados/singleton/{all/test-crash msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199771/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199771/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=61aeaaec401f4cba92b9fc92f0520421 Command failed on smithi125 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199778] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199778/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199778/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f83a3790164c4f308af6ad9e4b21d0b4 Command failed on smithi089 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199779] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:48 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199779/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199779/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=146c4284c8ae4aa597ccb213e298bdee Command failed on smithi097 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199781] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199781/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199781/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ad5d6439f17546b6b9251f3c79babd35 Command crashed: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir $TESTDIR/kvtest && cd $TESTDIR/kvtest && ceph_test_keyvaluedb'" [5199785] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} ----------------------------------------------------------------- time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199785/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199785/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2f12c29ccbc740bb805796a5ad99fc3b Command failed on smithi071 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199786] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199786/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199786/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fc248e76577b4f7a91d485fcaa8ae20f Command failed on smithi176 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199787] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:23:50 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199787/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199787/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=19cfcec47189402a9ada9b04a5a8ae47 Command failed on smithi188 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199793] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:41:15 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199793/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199793/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=37677b0196514f0986c7a019988cb73e Scrubbing terminated -- not all pgs were active and clean. [5199796] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:55:33 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199796/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199796/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=55b80426521741edb54d82d497967833 Scrubbing terminated -- not all pgs were active and clean. [5199800] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} ----------------------------------------------------------------- time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199800/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199800/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=df453a3cff9e4ec0820161bed2af7b56 Command failed on smithi154 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199802] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199802/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199802/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b04f51ce7d944026817b6c4bf1d7c308 Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5199804] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199804/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199804/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4a9c117e0ad5468bb197d8ff33be44f6 Command failed on smithi196 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199805] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199805/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199805/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3ca2d4d772154e35921a7e8392688c87 Command failed on smithi099 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199806] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 00:41:10 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199806/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199806/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7f64af626672496c9b0a2338cad370bc Scrubbing terminated -- not all pgs were active and clean. [5199813] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199813/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199813/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5ed91470ac394cfda2f2ccd45a86c7f8 Command failed on smithi006 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199814] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199814/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199814/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d068255c143f444d820386b0ea0d7ff1 Command failed on smithi026 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199815] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199815/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199815/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=50333c1dbaaf4bf499079411e48dd568 Command failed on smithi018 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199818] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:33:32 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199818/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199818/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f231c81683fd41b898f13a0e744b3566 reached maximum tries (180) after waiting for 180 seconds [5199820] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199820/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199820/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9c3f3f4c9c814f178670f472c1a5cf91 Command failed on smithi191 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199822] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} ----------------------------------------------------------------- time: 00:11:18 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199822/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199822/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e175987e856e403aa2e18dae8456ed0b Command failed on smithi097 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199826] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199826/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199826/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3a517c8426fa4fcc876b5e18e950b054 Command failed on smithi180 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199828] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:41:41 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199828/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199828/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c4d95de5aa7b4f17b1d50f1ca1e4785b "2020-07-05T11:13:18.546056+0000 mon.a (mon.0) 127 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5199833] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199833/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199833/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=decc9210fd1441318a60a5b4f06d14ff Command failed on smithi075 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199839] rados/singleton/{all/deduptool msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199839/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199839/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2af19f0bb5dc4525bca1f36f366b3a6f Command failed on smithi003 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199840] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} ----------------------------------------------------------------- time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199840/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199840/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5599a06efefd483c8278f884db039f16 Command failed on smithi057 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199841] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} ----------------------------------------------------------------- time: 00:10:31 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199841/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199841/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3d9a9bbf0f094189954a0b34ce11c401 Command failed on smithi123 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199843] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199843/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199843/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f33e9da9a70b46fc824f1a094b5dd785 Command failed on smithi189 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199844] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199844/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199844/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a718b41b4d114480850b6ad40dcfae45 Command failed on smithi193 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199847] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:24:05 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199847/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199847/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=455cc3626cd04e07b6acda91146109a3 reached maximum tries (180) after waiting for 180 seconds [5199854] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/workunits} ----------------------------------------------------------------- time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199854/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199854/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c12194e3308d4f698960d5c99e4d3d79 Command failed on smithi109 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199855] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199855/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199855/ '/home/ubuntu/cephtest/archive/syslog/misc.log:2020-07-05T11:27:33.235365+0 0:00 smithi133 bash[12421]: debug 2020-07-05T11:27:33.228+0000 7f18cf821700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:/usr/bin/podman:stderr Error: container_linux.go:349: starting container process caused "exec: \"/usr/sbin/ceph-volume\": stat /usr/sbin/ceph-volume: no such file or directory": OCI runtime command not found error ' in syslog [5199862] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199862/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199862/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=15f7ba77de304ce089f8b79ceb289e97 Command failed on smithi026 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199864] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:19:14 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199864/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199864/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7251f35fee39429c9160720cb0868299 Command failed on smithi095 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5199866] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199866/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199866/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cc7a53fee125461184696c2357062dd7 Command failed on smithi191 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' Dead ================================================================= [5199740] rados/multimon/{clusters/21 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199740/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199740/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=834b3d0b5cee46eb9070a19a7c56b7e1 reached maximum tries (60) after waiting for 900 seconds Pass ================================================================= [5199562] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:27:51 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199562/ [5199563] rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199563/ [5199564] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:45:10 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199564/ [5199565] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:07 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199565/ [5199566] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:39 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199566/ [5199568] rados/singleton/{all/dump-stuck msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199568/ [5199569] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_5925} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199569/ [5199570] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199570/ [5199571] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:24:59 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199571/ [5199573] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:24 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199573/ [5199576] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{ubuntu_latest}} time: 00:14:37 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199576/ [5199579] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199579/ [5199580] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:15:37 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199580/ [5199581] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:38 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199581/ [5199582] rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:38:06 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199582/ [5199583] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199583/ [5199584] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199584/ [5199586] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199586/ [5199587] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:16:35 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199587/ [5199588] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199588/ [5199590] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:43 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199590/ [5199591] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199591/ [5199592] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:25 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199592/ [5199594] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/progress} time: 00:16:25 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199594/ [5199595] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_18.04_podman} fixed-2} time: 00:20:19 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199595/ [5199596] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199596/ [5199598] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:52 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199598/ [5199599] rados/singleton/{all/lost-unfound-delete msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:34:10 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199599/ [5199602] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:12 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199602/ [5199604] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199604/ [5199605] rados/singleton/{all/lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:29:25 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199605/ [5199606] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199606/ [5199609] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:26:52 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199609/ [5199611] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:02:11 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199611/ [5199612] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:15:59 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199612/ [5199613] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:37 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199613/ [5199615] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199615/ [5199616] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199616/ [5199617] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{rhel_8}} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199617/ [5199618] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunk-promote-flush} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199618/ [5199619] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:24:32 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199619/ [5199620] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199620/ [5199621] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199621/ [5199622] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199622/ [5199625] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199625/ [5199626] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199626/ [5199628] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199628/ [5199629] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:39 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199629/ [5199631] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199631/ [5199634] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:25 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199634/ [5199636] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:21:51 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199636/ [5199637] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:41 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199637/ [5199638] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199638/ [5199639] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:33:10 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199639/ [5199642] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:20:32 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199642/ [5199643] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199643/ [5199644] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:30:25 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199644/ [5199645] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199645/ [5199646] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:02:31 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199646/ [5199647] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199647/ [5199648] rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199648/ [5199649] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199649/ [5199654] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199654/ [5199656] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:16:42 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199656/ [5199657] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:30 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199657/ [5199659] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:58 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199659/ [5199660] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:21:26 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199660/ [5199667] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_8}} time: 00:07:52 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199667/ [5199668] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:23 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199668/ [5199669] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:23:26 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199669/ [5199670] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199670/ [5199671] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:13:53 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199671/ [5199672] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:34:57 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199672/ [5199674] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199674/ [5199675] rados/singleton/{all/osd-backfill msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199675/ [5199676] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199676/ [5199677] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199677/ [5199678] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/crash} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199678/ [5199679] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:24:25 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199679/ [5199681] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:02:36 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199681/ [5199682] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:13:57 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199682/ [5199683] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:23:07 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199683/ [5199685] rados/singleton/{all/osd-recovery-incomplete msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:19:36 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199685/ [5199687] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{rhel_8}} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199687/ [5199688] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:35:24 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199688/ [5199690] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:19 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199690/ [5199691] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199691/ [5199692] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199692/ [5199693] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:32:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199693/ [5199694] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199694/ [5199695] rados/singleton/{all/osd-recovery msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:16:51 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199695/ [5199696] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:32:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199696/ [5199697] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199697/ [5199698] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199698/ [5199699] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:33 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199699/ [5199700] rados/singleton/{all/peer msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199700/ [5199702] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:37:14 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199702/ [5199703] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199703/ [5199705] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:28 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199705/ [5199708] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/failover} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199708/ [5199709] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199709/ [5199710] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199710/ [5199713] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:17:18 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199713/ [5199715] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} time: 01:01:11 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199715/ [5199716] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:22:02 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199716/ [5199717] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199717/ [5199718] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:14 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199718/ [5199719] rados/singleton/{all/pg-removal-interruption msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199719/ [5199721] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199721/ [5199722] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:23:20 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199722/ [5199723] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199723/ [5199728] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:46 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199728/ [5199729] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199729/ [5199730] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:20:18 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199730/ [5199732] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199732/ [5199734] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199734/ [5199736] rados/singleton/{all/random-eio msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:31:33 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199736/ [5199737] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199737/ [5199738] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/insights} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199738/ [5199739] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199739/ [5199741] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{rhel_8}} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199741/ [5199742] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199742/ [5199743] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:21:47 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199743/ [5199744] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:18:06 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199744/ [5199745] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199745/ [5199747] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:03 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199747/ [5199748] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:01:47 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199748/ [5199750] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{rhel_8.0} fixed-2} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199750/ [5199752] rados/singleton/{all/recovery-preemption msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:17:41 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199752/ [5199753] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:27:50 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199753/ [5199754] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199754/ [5199756] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_5925} time: 00:09:00 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199756/ [5199759] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199759/ [5199762] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:25:11 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199762/ [5199763] rados/singleton/{all/resolve_stuck_peering msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:09:03 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199763/ [5199764] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199764/ [5199765] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199765/ [5199766] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199766/ [5199767] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:28:02 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199767/ [5199769] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199769/ [5199770] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199770/ [5199772] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199772/ [5199773] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:30 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199773/ [5199774] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:28:46 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199774/ [5199775] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199775/ [5199776] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{ubuntu_latest}} time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199776/ [5199777] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:17 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199777/ [5199780] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:14 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199780/ [5199782] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:19:57 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199782/ [5199783] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:37:18 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199783/ [5199784] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199784/ [5199788] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199788/ [5199789] rados/singleton/{all/thrash-backfill-full msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:37:04 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199789/ [5199790] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199790/ [5199791] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:44 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199791/ [5199792] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199792/ [5199794] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/progress} time: 00:18:03 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199794/ [5199795] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199795/ [5199797] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/dedup_tier} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199797/ [5199798] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:56 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199798/ [5199799] rados/singleton/{all/thrash-eio msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:30:03 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199799/ [5199801] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199801/ [5199803] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199803/ [5199807] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:11 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199807/ [5199808] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199808/ [5199809] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199809/ [5199810] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{centos_8}} time: 00:18:49 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199810/ [5199811] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:27:17 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199811/ [5199812] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199812/ [5199816] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:29:12 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199816/ [5199817] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199817/ [5199819] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:02:20 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199819/ [5199821] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199821/ [5199823] rados/singleton/{all/watch-notify-same-primary msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199823/ [5199824] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:59 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199824/ [5199825] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:14:32 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199825/ [5199827] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:17:31 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199827/ [5199829] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 01:04:11 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199829/ [5199830] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199830/ [5199831] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199831/ [5199832] rados/singleton/{all/admin-socket msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199832/ [5199834] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199834/ [5199835] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:20:14 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199835/ [5199836] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199836/ [5199837] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench} time: 01:44:38 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199837/ [5199838] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:04 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199838/ [5199842] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199842/ [5199845] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:13:46 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199845/ [5199846] rados/singleton/{all/divergent_priors msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199846/ [5199848] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{centos_8}} time: 00:28:37 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199848/ [5199849] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199849/ [5199850] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:00:55 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199850/ [5199851] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 04:48:07 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199851/ [5199852] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199852/ [5199853] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:08 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199853/ [5199856] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:30 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199856/ [5199857] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:27:41 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199857/ [5199858] rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199858/ [5199859] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:19:45 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199859/ [5199860] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:34 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199860/ [5199861] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:20:50 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199861/ [5199863] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199863/ [5199865] rados/singleton/{all/dump-stuck msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199865/ [5199867] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:12 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199867/ [5199868] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199868/ [5199869] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:14 info: http://pulpito.ceph.com/teuthology-2020-07-05_07:01:02-rados-master-distro-basic-smithi/5199869/