2020-07-02T04:55:34.820 INFO:root:teuthology version: 1.0.0-5208279 2020-07-02T04:55:34.822 INFO:teuthology.results:subset: '16/9999' 2020-07-02T04:55:34.822 INFO:teuthology.results:seed: '4239' 2020-07-02T07:36:07.012 INFO:root:teuthology version: 1.0.0-5208279 2020-07-02T07:36:07.027 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-07-02T12:24:16.790 INFO:teuthology.results:Tests finished! gathering results... 2020-07-02T12:24:36.084 INFO:scrape:Found 308 jobs 2020-07-02T12:24:59.968 INFO:scrape:Found 7 distinct failure reasons 2020-07-02T12:24:59.970 INFO:scrape:Failure: Command failed on smithi149 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' 2020-07-02T12:24:59.970 INFO:scrape:80 jobs 2020-07-02T12:24:59.971 INFO:scrape:suites intersection: [] 2020-07-02T12:24:59.972 INFO:scrape:suites union: ['1-install/nautilus', '1-pg-log-overrides/short_pg_log', '2-partial-upgrade/firsthalf', '2-recovery-overrides/{more-active-recovery}', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'backoff/peering_and_degraded', 'bluestore-bitmap', 'ceph', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'd-balancer/on', 'd-thrash/default/{default', 'd-thrash/none', 'debug/mgr', 'fixed-2', 'mode/packaged', 'mode/root', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/cephadm/with-work/{distro/centos_8.0', 'rados/cephadm/with-work/{distro/centos_latest', 'rados/cephadm/with-work/{distro/rhel_8.0', 'rados/cephadm/with-work/{distro/rhel_latest', 'rados/cephadm/with-work/{distro/ubuntu_18.04', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/objectstore/{backends/alloc-hint', 'rados/objectstore/{backends/fusestore', 'rados/objectstore/{backends/objectcacher-stress', 'rados/rest/{mgr-restful', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/balancer', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/pool-access', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/deduptool', 'rados/singleton/{all/erasure-code-nonregression', 'rados/singleton/{all/mon-auth-caps', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-key-caps', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/radostool', 'rados/singleton/{all/test-crash', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/standalone/{supported-random-distro$/{centos_8}', 'rados/standalone/{supported-random-distro$/{rhel_8}', 'rados/standalone/{supported-random-distro$/{ubuntu_latest}', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rados/verify/{centos_latest', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start', 'start}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'task/test_adoption}', 'task/test_cephadm_repos}', 'task/test_cephadm}', 'tasks/rados_api_tests', 'tasks/rados_api_tests}', 'tasks/rados_cls_all', 'tasks/rados_cls_all}', 'tasks/rados_python}', 'tasks/rados_stress_watch}', 'tasks/rados_workunit_loadgen_big}', 'tasks/rados_workunit_loadgen_mix}', 'tasks/rados_workunit_loadgen_mostlyread}', 'tasks/workunits}', 'thrashers/force-sync-many', 'thrashers/many', 'thrashers/none', 'thrashers/sync', 'thrashosds-health', 'thrashosds-health}', 'ubuntu_latest}', 'validater/lockdep}', 'validater/valgrind}', 'workloads/crush}', 'workloads/erasure-code}', 'workloads/mgr}', 'workloads/misc}', 'workloads/mon}', 'workloads/osd}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/rados_mon_workunits}', 'workloads/scrub}'] 2020-07-02T12:24:59.973 INFO:scrape: 2020-07-02T12:24:59.973 INFO:scrape:Failure: Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) 2020-07-02T12:24:59.973 INFO:scrape:4 jobs: ['5193917', '5193833', '5193990', '5194068'] 2020-07-02T12:24:59.974 INFO:scrape:suites intersection: ['task/test_orch_cli}'] 2020-07-02T12:24:59.974 INFO:scrape:suites union: ['rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_orch_cli}'] 2020-07-02T12:24:59.975 INFO:scrape: 2020-07-02T12:24:59.975 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean. 2020-07-02T12:24:59.975 INFO:scrape:4 jobs: ['5193987', '5194100', '5193865', '5193968'] 2020-07-02T12:24:59.976 INFO:scrape:suites intersection: ['rados'] 2020-07-02T12:24:59.976 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'd-balancer/on', 'd-thrash/default/{default', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/verify/{centos_latest', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'thrashers/none', 'thrashosds-health', 'thrashosds-health}', 'validater/valgrind}', 'workloads/set-chunk-promote-flush}'] 2020-07-02T12:24:59.977 INFO:scrape: 2020-07-02T12:24:59.977 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-07-02T12:24:59.978 INFO:scrape:4 jobs: ['5194067', '5193937', '5193906', '5193969'] 2020-07-02T12:24:59.978 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{centos_7.6}', 'rados', 'thrashosds-health', 'three-plus-one}'] 2020-07-02T12:24:59.978 INFO:scrape:suites union: ['1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus-v1only', '1-install/octopus', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{centos_7.6}', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/careful', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/test_rbd_api}'] 2020-07-02T12:24:59.979 INFO:scrape: 2020-07-02T12:24:59.979 INFO:scrape:Failure: {'Failure object was': {'smithi142.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost-random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu-kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} 2020-07-02T12:24:59.980 INFO:scrape:1 jobs: ['5193870'] 2020-07-02T12:24:59.980 INFO:scrape:suites: ['debug/mgr', 'objectstore/bluestore-stupid', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_8}', 'tasks/failover}'] 2020-07-02T12:24:59.981 INFO:scrape: 2020-07-02T12:24:59.981 INFO:scrape:Crash: Command crashed: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir $TESTDIR/kvtest && cd $TESTDIR/kvtest && ceph_test_keyvaluedb'" 2020-07-02T12:24:59.982 INFO:scrape:ceph version 16.0.0-2962-g5ccfc2d5d3 (5ccfc2d5d3a03d700cf9c4a48b194d7836328981) pacific (dev) 1: (()+0x12890) [0x7f395a0bf890] 2: (gsignal()+0xc7) [0x7f394f3ebe97] 3: (abort()+0x141) [0x7f394f3ed801] 4: (()+0x3039a) [0x7f394f3dd39a] 5: (()+0x30412) [0x7f394f3dd412] 6: (rocksdb::ColumnFamilySet::~ColumnFamilySet()+0x91) [0x5617f932cfcf] 7: (std::default_delete::operator()(rocksdb::ColumnFamilySet*) const+0x22) [0x5617f917174c] 8: (std::unique_ptr >::reset(rocksdb::ColumnFamilySet*)+0x55) [0x5617f916bc73] 9: (rocksdb::VersionSet::~VersionSet()+0x5e) [0x5617f9150b00] 10: (rocksdb::VersionSet::~VersionSet()+0x18) [0x5617f9150c88] 11: (std::default_delete::operator()(rocksdb::VersionSet*) const+0x2e) [0x5617f8ff6f22] 12: (std::unique_ptr >::reset(rocksdb::VersionSet*)+0x55) [0x5617f8fe95c1] 13: (rocksdb::DBImpl::CloseHelper()+0xaaa) [0x5617f8fb2b82] 14: (rocksdb::DBImpl::~DBImpl()+0x5d) [0x5617f8fb300b] 15: (rocksdb::DBImpl::~DBImpl()+0x18) [0x5617f8fb33ce] 16: (RocksDBStore::close()+0x31a) [0x5617f8f84faa] 17: (RocksDBStore::reshard(std::__cxx11::basic_string, std::allocator > const&, RocksDBStore::resharding_ctrl const*)+0x31e) [0x5617f8f8bbfe] 18: (RocksDBResharding_change_reshard_Test::TestBody()+0x15a) [0x5617f8efdc6a] 19: (void testing::internal::HandleExceptionsInMethodIfSupported(testing::Test*, void (testing::Test::*)(), char const*)+0x4a) [0x5617f8f46bca] 20: (testing::Test::Run()+0xc3) [0x5617f8f3c843] 21: (testing::TestInfo::Run()+0x135) [0x5617f8f3c9a5] 22: (testing::TestSuite::Run()+0xb5) [0x5617f8f3ca85] 23: (testing::internal::UnitTestImpl::RunAllTests()+0x478) [0x5617f8f3cf98] 24: (bool testing::internal::HandleExceptionsInMethodIfSupported(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*)+0x4a) [0x5617f8f470da] 25: (testing::UnitTest::Run()+0x98) [0x5617f8f3d1a8] 26: (main()+0x152) [0x5617f8ee79e2] 27: (__libc_start_main()+0xe7) [0x7f394f3ceb97] 28: (_start()+0x2a) [0x5617f8eea4ca] 2020-07-02T12:24:59.982 INFO:scrape:1 jobs: ['5194051'] 2020-07-02T12:24:59.982 INFO:scrape:suites: ['rados/objectstore/{backends/keyvaluedb', 'supported-random-distro$/{ubuntu_latest}}'] 2020-07-02T12:24:59.983 INFO:scrape: 2020-07-02T12:24:59.983 INFO:scrape:Failure: "2020-07-02T06:05:59.895940+0000 mon.a (mon.0) 124 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log 2020-07-02T12:24:59.984 INFO:scrape:1 jobs: ['5193896'] 2020-07-02T12:24:59.984 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'validater/lockdep}'] 2020-07-02T12:24:59.984 INFO:scrape: 2020-07-02T12:24:59.998 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/ failed: 94 dead: 1 running: 0 waiting: 0 queued: 0 passed: 213 Fail ================================================================= [5193830] rados/singleton/{all/radostool msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193830/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193830/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=52fe0d546f744a4b960aaf205afc2bfc Command failed on smithi205 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193833] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} ----------------------------------------------------------------- time: 00:12:53 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193833/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193833/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=67675d3ce931416aaf0c3b8e7c0921a5 Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5193836] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:26:41 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193836/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193836/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3e93498a9d1c4bf685aa11d58b06d185 Command failed on smithi149 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193839] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193839/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193839/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a2b88c3943794176bfa8711fcf815482 Command failed on smithi190 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193843] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193843/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193843/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8ada7ca26bef488b8ec63c00479dfcaa Command failed on smithi104 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193844] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193844/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193844/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cb6d042ec8a64209b80df64f4eb1d2dc Command failed on smithi137 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.a && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.a && cd /home/ubuntu/cephtest/clone.client.a && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193846] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} ----------------------------------------------------------------- time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193846/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193846/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f7e49847d18e43038f8e3ce44362e56b Command failed on smithi114 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193847] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 03:12:46 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193847/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193847/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fb94870b193544118fbdd5e96be379aa Command failed on smithi007 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193857] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193857/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193857/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e552410a0a6a40e19eaa24633e613e02 Command failed on smithi032 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193863] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193863/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193863/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bc18a62e642f433c97e50e612516e8d8 Command failed on smithi190 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193865] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:58:06 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193865/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193865/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=06a3ed321fac41be85b8b99725fa8d5b Scrubbing terminated -- not all pgs were active and clean. [5193866] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} ----------------------------------------------------------------- time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193866/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193866/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=53112d6842524c7a98bf64562ffb052a Command failed on smithi044 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193869] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:23:03 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193869/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193869/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5e0c7189d7074a5f945ba5919d58b0a5 Command failed on smithi192 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193875] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} ----------------------------------------------------------------- time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193875/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193875/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=721b6a570622451bb3819c263f4bc789 Command failed on smithi096 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193880] rados/singleton/{all/test-crash msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193880/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193880/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b7a2edd8e93d465eab570e8889aa23c3 Command failed on smithi052 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193888] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193888/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193888/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b96a5e744e8e464db12aa6bb415e5be6 Command failed on smithi044 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193889] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} ----------------------------------------------------------------- time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193889/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193889/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=acba33c049f0409cbd01c640a5a38837 Command failed on smithi074 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193891] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193891/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193891/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2853202a368c45bab55b246259f09578 Command failed on smithi193 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193894] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:39 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193894/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193894/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c3bca8e59661476ea5ef035c08f4eecb Command failed on smithi155 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193896] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:41:28 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193896/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193896/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4c4fd78606ac445cb7a0b114a3c0d603 "2020-07-02T06:05:59.895940+0000 mon.a (mon.0) 124 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY)" in cluster log [5193898] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193898/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193898/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=388fc425ec8a4d54b8ed1657e3c10349 Command failed on smithi137 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193906] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:24:51 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193906/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193906/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a528b2aeb3de4ffda54b5164afcc14e1 reached maximum tries (180) after waiting for 180 seconds [5193909] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:22:39 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193909/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193909/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1385f4d34d924ea6a25b084e1a1682c6 Command failed on smithi122 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193911] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193911/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193911/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1cdfd6ff12da46abb944462747eeaeca Command failed on smithi146 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193915] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:12:03 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193915/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193915/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ffd858d910754355a0e854ef0b94785f Command failed on smithi082 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193917] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193917/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193917/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1d162a0d727c48a083e68389e39b7e9b Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5193918] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193918/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193918/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=75fc52b1621f461bb2a6932e6cd1d10e Command failed on smithi008 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193923] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:16:11 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193923/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193923/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0d93c3b664e447318f8d3a08ee6a1839 Command failed on smithi132 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193929] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:19:00 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193929/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193929/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=015f6b3d249f4da38a40993393e4bd5f Command failed on smithi200 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193931] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} ----------------------------------------------------------------- time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193931/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193931/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=621a5d4b82c543a48a2c593ce10c98e6 Command failed on smithi044 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193936] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} ----------------------------------------------------------------- time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193936/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193936/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e95714a345ab42dc866cde4f216d7ff8 Command failed on smithi155 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193937] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:24:55 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193937/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193937/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6c6d97301f0d4e4ab3a915f8023fd62e reached maximum tries (180) after waiting for 180 seconds [5193944] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193944/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193944/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f21ec9a2d44e47f69de73c424fa5850b Command failed on smithi157 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193949] rados/singleton/{all/deduptool msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193949/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193949/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fff920c1c2324c06acc4ad32f4102569 Command failed on smithi204 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193950] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193950/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193950/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8c83823a85c444698d97224bac792c24 Command failed on smithi092 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193951] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} ----------------------------------------------------------------- time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193951/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193951/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=12c71fce07d145f49c3ec4504c4c05b1 Command failed on smithi161 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193954] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:18:54 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193954/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193954/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f2736c265ca942f982a1b63fe482dd2c Command failed on smithi084 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193957] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193957/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193957/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=56c50d97d86a4e5b908c1586821ab0ab Command failed on smithi045 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193967] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193967/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193967/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=812943c133ef48aba2d7fd6d75d8566c Command failed on smithi044 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193968] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:41:14 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193968/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193968/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b79146a466184a6db6770e8c67519111 Scrubbing terminated -- not all pgs were active and clean. [5193969] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:25:12 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193969/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193969/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=22edc4a7ec914684a7ded2022400a29e reached maximum tries (180) after waiting for 180 seconds [5193972] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_python} ----------------------------------------------------------------- time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193972/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193972/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=20e3364a343e48e8bfb650d3687a35b3 Command failed on smithi164 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193976] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:24:05 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193976/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193976/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0a0f979c8a6f4cf78f51e90ec84e16f7 Command failed on smithi134 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193977] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193977/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193977/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3eee19b39c34465bafdc1888e87bf580 Command failed on smithi114 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193978] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} ----------------------------------------------------------------- time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193978/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193978/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a9aa3510b8744a8bad41b10674e6ac1d Command failed on smithi061 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193980] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193980/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193980/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7946cbb1985a40e3b70f48ce3bb01560 Command failed on smithi089 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193987] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 00:56:56 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193987/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193987/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e7e58a70e302464badc480fe80a1ebcd Scrubbing terminated -- not all pgs were active and clean. [5193988] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193988/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193988/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=87d0624f75e3430e948cfee5b6d6a3cd Command failed on smithi187 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193990] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} ----------------------------------------------------------------- time: 00:12:59 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193990/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193990/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=68d91ee3f8984ad199266d5f4297f2b7 Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5193992] rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193992/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193992/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=890c80773e764a82ae484b7585cdd8ed Command failed on smithi158 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193994] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:22:52 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193994/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193994/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=90341418f05046ccbac8a5d0de62702a Command failed on smithi175 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5193997] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} ----------------------------------------------------------------- time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193997/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193997/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=33a3f66d30b648b783bb5002559c16d2 Command failed on smithi099 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194004] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194004/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194004/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=44bd9493f64340129db22808b97de313 Command failed on smithi035 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194013] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194013/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194013/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=8f946d1c6e444f3abd4443ae65feaa21 Command failed on smithi133 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194018] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/workunits} ----------------------------------------------------------------- time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194018/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194018/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=78c3bac066af440bb3b75e84b26ef1ca Command failed on smithi016 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194019] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} ----------------------------------------------------------------- time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194019/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194019/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2f04e627a8ce4e7aa9ad4f19152e3f97 Command failed on smithi040 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194020] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} ----------------------------------------------------------------- time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194020/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194020/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a26cea6ba3164bc48340804e20d6c969 Command failed on smithi081 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194023] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:21:18 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194023/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194023/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=42390e739d5a457b8cd900b9a9f3a078 Command failed on smithi118 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194025] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:12:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194025/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194025/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=259dc2fab2b44635b7084855700c7879 Command failed on smithi097 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194029] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} ----------------------------------------------------------------- time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194029/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194029/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1cdd4bc539f043c386aa04bb9b10b9ef Command failed on smithi050 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194036] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194036/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194036/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a52dc0acb5ae4a31af41bda79282f2ad Command failed on smithi161 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194040] rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:41 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194040/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194040/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3f82a34e1ed74b59999d559dab661787 Command failed on smithi095 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194041] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:22:41 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194041/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194041/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ce87363a416c499e9ad70369b885c64f Command failed on smithi089 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194044] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:30:10 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194044/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194044/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5a14556741e6414db925558e3aa84c5d Command failed on smithi176 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194045] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194045/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194045/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=aefb1411c91046f78a78bdef4a710057 Command failed on smithi159 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194049] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:28 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194049/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194049/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=35139ad78eaf44f0925770a4b827d523 Command failed on smithi070 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194051] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:06:54 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194051/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194051/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c1de5caa6e0e4e6394a28d962538efe8 Command crashed: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'mkdir $TESTDIR/kvtest && cd $TESTDIR/kvtest && ceph_test_keyvaluedb'" [5194053] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} ----------------------------------------------------------------- time: 00:13:08 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194053/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194053/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=22af2a044521419b9cef4d5afdeb211f Command failed on smithi134 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194054] rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194054/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194054/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0e097738ab70493cafa3d7b9cd41297b Command failed on smithi123 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194060] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194060/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194060/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f6271dc83d8b4d48bb900f49e1c04a63 Command failed on smithi040 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194063] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} ----------------------------------------------------------------- time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194063/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194063/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cbf0ba8df3ee4f2b81687902b03694c4 Command failed on smithi133 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194064] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:19:52 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194064/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194064/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=375e3a6d088e4f10850f44a5a60f82d6 Command failed on smithi104 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194067] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:25:01 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194067/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194067/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=040cd421263247a3b74a849241112f8f reached maximum tries (180) after waiting for 180 seconds [5194068] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:13:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194068/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194068/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=60f81f8c14ca4aeab7113d97726f970d Test failure: test_create_and_delete_cluster (tasks.cephfs.test_nfs.TestNFS) [5194069] rados/singleton/{all/mon-config msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194069/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194069/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6045ccf2a1c3410d9a19d43e6946472b Command failed on smithi195 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194073] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} ----------------------------------------------------------------- time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194073/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194073/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f3df55595e654bacb8e54bc5e64acc5b Command failed on smithi132 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194078] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194078/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194078/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3c3e59fc6af04f0ca2734cadccb53cae Command failed on smithi159 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194083] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194083/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194083/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1c322ca646714429a6404a2c5950a655 Command failed on smithi139 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194084] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:18:47 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194084/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194084/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d55d4560f7f2440d8029ea0974bc7b85 Command failed on smithi084 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194087] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} ----------------------------------------------------------------- time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194087/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194087/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=af91f76d71bd41e58bd6e3c456a977f7 Command failed on smithi131 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194095] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194095/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194095/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4fcdf57775b14c15bbebd75cc98989c5 Command failed on smithi164 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194098] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} ----------------------------------------------------------------- time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194098/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194098/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0631075426474c3096b76a0767bb58a5 Command failed on smithi142 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194100] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/set-chunk-promote-flush} ----------------------------------------------------------------- time: 00:45:11 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194100/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194100/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=286f13369a2f40f3b273c38913ef83f6 Scrubbing terminated -- not all pgs were active and clean. [5194101] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:23:28 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194101/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194101/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d318f80687da46928a19f0c69f89115a Command failed on smithi174 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194106] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} ----------------------------------------------------------------- time: 00:14:08 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194106/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194106/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=aa31825cf6614e5baf66a17c3d7e96d2 Command failed on smithi098 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194107] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} ----------------------------------------------------------------- time: 00:10:38 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194107/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194107/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=decac19cde394b2e9b21f440df6d1e1e Command failed on smithi089 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194109] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 00:27:59 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194109/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194109/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=700bd74b36884a7fb415dab32d153e06 Command failed on smithi175 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194111] rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:15:28 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194111/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194111/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=423fa5470ed34f738ff1917aa33319c9 Command failed on smithi190 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194114] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194114/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194114/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3d36caf16f664c38ba3a28a457a25da8 Command failed on smithi016 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194123] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:22:49 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194123/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194123/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e53f465e298440b397f62efb5e504c0e Command failed on smithi122 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194126] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194126/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194126/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=61a38fd594434417a5a1d074f9260d27 Command failed on smithi139 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194127] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:17:22 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194127/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194127/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b26320adf4274c85bc6be1f9d33320da Command failed on smithi185 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194128] rados/singleton/{all/radostool msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194128/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194128/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b781b6af56664b8893ff112f78d9efdc Command failed on smithi131 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' [5194132] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194132/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194132/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=98d21983d80146ac8019ca31deaf199a Command failed on smithi074 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout baa1ea6a9656c3db06c66032fa80b476721947ba' Dead ================================================================= [5193870] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/failover} ----------------------------------------------------------------- time: 00:02:43 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193870/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193870/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=670a6cf643f447d4b524ed6eaabad8e4 {'Failure object was': {'smithi142.front.sepia.ceph.com': {'msg': 'Failed to download packages: Cannot download Packages/boost- random-1.66.0-6.el8.x86_64.rpm: All mirrors were tried', 'results': [], 'invocation': {'module_args': {'name': ['dnf-utils', 'sysstat', 'libedit', 'boost-thread', 'xfsprogs', 'gdisk', 'parted', 'libgcrypt', 'fuse-libs', 'openssl', 'libuuid', 'podman', 'podman-docker', 'attr', 'ant', 'lsof', 'gettext', 'bc', 'xfsdump', 'blktrace', 'usbredir', 'libev-devel', 'valgrind', 'nfs-utils', 'ncurses-devel', 'gcc', 'git', 'python3-nose', 'python3-virtualenv', 'genisoimage', 'qemu-img', 'qemu-kvm-core', 'qemu- kvm-block-rbd', 'libacl-devel', 'dbench', 'autoconf', 'gdb', 'iozone'], 'state': 'present', 'allow_downgrade': False, 'autoremove': False, 'bugfix': False, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'installroot': '/', 'install_repoquery': True, 'install_weak_deps': True, 'security': False, 'skip_broken': False, 'update_cache': False, 'update_only': False, 'validate_certs': True, 'lock_timeout': 30, 'conf_file': 'None', 'disable_excludes': 'None', 'download_dir': 'None', 'list': 'None', 'releasever': 'None'}}, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_te uthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/s rc/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_gi t_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ce ph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', '/')"} Pass ================================================================= [5193829] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:13 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193829/ [5193831] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193831/ [5193832] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193832/ [5193834] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunk-promote-flush} time: 00:29:54 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193834/ [5193835] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:36:44 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193835/ [5193837] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/crash} time: 00:12:46 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193837/ [5193838] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193838/ [5193840] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:55 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193840/ [5193841] rados/singleton/{all/random-eio msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:20:26 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193841/ [5193842] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard} time: 01:04:00 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193842/ [5193845] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_8}} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193845/ [5193848] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:30:39 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193848/ [5193849] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193849/ [5193850] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193850/ [5193851] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:13:04 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193851/ [5193852] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193852/ [5193853] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193853/ [5193854] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:26:18 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193854/ [5193855] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193855/ [5193856] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:15:04 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193856/ [5193858] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:17:27 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193858/ [5193859] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:23:14 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193859/ [5193860] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193860/ [5193861] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193861/ [5193862] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{rhel_latest} fixed-2} time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193862/ [5193864] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:06 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193864/ [5193867] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:30:08 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193867/ [5193868] rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193868/ [5193871] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:15:50 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193871/ [5193872] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:38:17 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193872/ [5193873] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:29 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193873/ [5193874] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193874/ [5193876] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:31:49 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193876/ [5193877] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193877/ [5193878] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:17 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193878/ [5193879] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:12:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193879/ [5193881] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} time: 00:25:00 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193881/ [5193882] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{centos_8}} time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193882/ [5193883] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193883/ [5193884] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193884/ [5193885] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} time: 01:51:57 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193885/ [5193886] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} time: 00:21:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193886/ [5193887] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193887/ [5193890] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:29 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193890/ [5193892] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193892/ [5193893] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 01:01:10 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193893/ [5193895] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193895/ [5193897] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:10:28 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193897/ [5193899] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:57 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193899/ [5193900] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193900/ [5193901] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/insights} time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193901/ [5193902] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:17 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193902/ [5193903] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:41:55 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193903/ [5193904] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193904/ [5193905] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:52 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193905/ [5193907] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:35 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193907/ [5193908] rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193908/ [5193910] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:23:31 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193910/ [5193912] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced} time: 00:25:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193912/ [5193913] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:03:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193913/ [5193914] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:07:39 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193914/ [5193916] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_5925} time: 00:14:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193916/ [5193919] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:23:54 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193919/ [5193920] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193920/ [5193921] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193921/ [5193922] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:22:19 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193922/ [5193924] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193924/ [5193925] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193925/ [5193926] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193926/ [5193927] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} time: 00:30:41 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193927/ [5193928] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:28:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193928/ [5193930] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193930/ [5193932] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:25:47 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193932/ [5193933] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{rhel_8}} time: 00:11:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193933/ [5193934] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:41 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193934/ [5193935] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193935/ [5193938] rados/singleton/{all/admin-socket msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193938/ [5193939] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193939/ [5193940] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193940/ [5193941] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193941/ [5193942] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read} time: 00:24:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193942/ [5193943] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:23:51 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193943/ [5193945] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193945/ [5193946] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:02:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193946/ [5193947] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:14:15 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193947/ [5193948] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:21:16 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193948/ [5193952] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{ubuntu_latest}} time: 00:08:03 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193952/ [5193953] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193953/ [5193955] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:09:20 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193955/ [5193956] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193956/ [5193958] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193958/ [5193959] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/progress} time: 00:16:17 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193959/ [5193960] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193960/ [5193961] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:26:29 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193961/ [5193962] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193962/ [5193963] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:28:41 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193963/ [5193964] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:43 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193964/ [5193965] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193965/ [5193966] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193966/ [5193970] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193970/ [5193971] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:24:05 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193971/ [5193973] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193973/ [5193974] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:24:23 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193974/ [5193975] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193975/ [5193979] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:13:27 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193979/ [5193981] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:46 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193981/ [5193982] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:28:27 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193982/ [5193983] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:30:57 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193983/ [5193984] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193984/ [5193985] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:24:02 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193985/ [5193986] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:55 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193986/ [5193989] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:14:39 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193989/ [5193991] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193991/ [5193993] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:28 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193993/ [5193995] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:19 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193995/ [5193996] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:27:56 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193996/ [5193998] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193998/ [5193999] rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:28:17 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5193999/ [5194000] rados/multimon/{clusters/21 msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:23:05 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194000/ [5194001] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:22:33 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194001/ [5194002] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects} time: 00:23:50 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194002/ [5194003] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194003/ [5194005] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194005/ [5194006] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194006/ [5194007] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{ubuntu_latest}} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194007/ [5194008] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194008/ [5194009] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:33:45 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194009/ [5194010] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194010/ [5194011] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_latest} fixed-2} time: 00:18:02 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194011/ [5194012] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:38 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194012/ [5194014] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/dedup_tier} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194014/ [5194015] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194015/ [5194016] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194016/ [5194017] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194017/ [5194021] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194021/ [5194022] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194022/ [5194024] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:08:52 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194024/ [5194026] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:59 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194026/ [5194027] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194027/ [5194028] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:51 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194028/ [5194030] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:07:25 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194030/ [5194031] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:05 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194031/ [5194032] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194032/ [5194033] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:11:59 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194033/ [5194034] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:40:18 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194034/ [5194035] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/one workloads/snaps-few-objects} time: 00:44:09 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194035/ [5194037] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194037/ [5194038] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:37 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194038/ [5194039] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{rhel_8}} time: 00:17:14 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194039/ [5194042] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/crash} time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194042/ [5194043] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:40 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194043/ [5194046] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:43:49 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194046/ [5194047] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:08 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194047/ [5194048] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194048/ [5194050] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 01:03:10 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194050/ [5194052] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:21:46 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194052/ [5194055] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194055/ [5194056] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:46 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194056/ [5194057] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:37 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194057/ [5194058] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:32 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194058/ [5194059] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} time: 01:38:44 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194059/ [5194061] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{rhel_8}} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194061/ [5194062] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194062/ [5194065] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:33 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194065/ [5194066] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} time: 00:15:47 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194066/ [5194070] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} time: 00:19:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194070/ [5194071] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194071/ [5194072] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:16 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194072/ [5194074] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/failover} time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194074/ [5194075] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194075/ [5194076] rados/singleton/{all/osd-backfill msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:20:13 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194076/ [5194077] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194077/ [5194079] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194079/ [5194080] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{rhel_8}} time: 00:21:33 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194080/ [5194081] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:15:01 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194081/ [5194082] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:02:16 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194082/ [5194085] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:01 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194085/ [5194086] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:21:02 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194086/ [5194088] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:16:03 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194088/ [5194089] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194089/ [5194090] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:40 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194090/ [5194091] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:19:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194091/ [5194092] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:13:27 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194092/ [5194093] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:27:33 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194093/ [5194094] rados/singleton/{all/osd-recovery msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194094/ [5194096] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194096/ [5194097] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194097/ [5194099] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:29:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194099/ [5194102] rados/singleton/{all/peer msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194102/ [5194103] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:15 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194103/ [5194104] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:16:45 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194104/ [5194105] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194105/ [5194108] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194108/ [5194110] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194110/ [5194112] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:14:07 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194112/ [5194113] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_8}} time: 00:31:31 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194113/ [5194115] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:55 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194115/ [5194116] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 01:01:23 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194116/ [5194117] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 04:42:24 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194117/ [5194118] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194118/ [5194119] rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:45 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194119/ [5194120] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:07:52 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194120/ [5194121] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194121/ [5194122] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:22:48 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194122/ [5194124] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-radosbench} time: 01:26:59 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194124/ [5194125] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:02 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194125/ [5194129] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:43:19 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194129/ [5194130] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194130/ [5194131] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:19:27 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194131/ [5194133] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:26:35 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194133/ [5194134] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:44:33 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194134/ [5194135] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:31:33 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194135/ [5194136] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2020-07-01_07:01:02-rados-master-distro-basic-smithi/5194136/