2021-03-10T17:58:42.959 INFO:root:teuthology version: 1.1.0-b6eecfe8 2021-03-10T17:58:42.960 INFO:teuthology.results:subset: '18553/99999' 2021-03-10T17:58:42.961 INFO:teuthology.results:seed: '3973' 2021-03-10T20:41:27.680 INFO:root:teuthology version: 1.1.0-b6eecfe8 2021-03-10T20:41:27.709 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-03-11T07:46:29.533 INFO:teuthology.results:Tests finished! gathering results... 2021-03-11T07:47:09.562 INFO:scrape:Found 343 jobs 2021-03-11T07:47:14.937 INFO:scrape:Found 8 distinct failure reasons 2021-03-11T07:47:14.939 INFO:scrape:Failure: Command failed on smithi199 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:87cd59fd3ebb82c3ebadd5335e99940fbb5394cc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88dd262a-81df-11eb-9080-001a4aab830c -- ceph orch host ls --format=json' 2021-03-11T07:47:14.939 INFO:scrape:5 jobs: ['5952020', '5951855', '5952023', '5952028', '5952013'] 2021-03-11T07:47:14.940 INFO:scrape:suites intersection: [] 2021-03-11T07:47:14.940 INFO:scrape:suites union: ['1-start', '2-thrash', '3-tasks/rados_api_tests', 'fixed-2', 'mode/root', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'rados/cephadm/smoke-roleless/{distro/ubuntu_20.04_kubic_testing', 'rados/cephadm/smoke/{distro/ubuntu_20.04_kubic_stable', 'rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_stable', 'rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_testing', 'rados/cephadm/with-work/{0-distro/ubuntu_20.04_kubic_stable', 'root}', 'start', 'start}', 'tasks/rados_python}'] 2021-03-11T07:47:14.941 INFO:scrape: 2021-03-11T07:47:14.941 INFO:scrape:Dead: b'2021-03-11T07:31:38.485 DEBUG:teuthology.exit:Finished running handlers' 2021-03-11T07:47:14.941 INFO:scrape:3 jobs: ['5951915', '5951951', '5951891'] 2021-03-11T07:47:14.942 INFO:scrape:suites intersection: ['msgr-failures/few', 'rados'] 2021-03-11T07:47:14.942 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'fast/fast', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-zlib', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/singleton/{all/thrash-eio', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/verify/{centos_latest', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rados_api_tests', 'thrashers/careful', 'thrashosds-health', 'thrashosds-health}', 'validater/valgrind}', 'workloads/ec-small-objects-overwrites}'] 2021-03-11T07:47:14.943 INFO:scrape: 2021-03-11T07:47:14.943 INFO:scrape:Failure: Test failure: test_create_and_delete_export (tasks.cephfs.test_nfs.TestNFS) 2021-03-11T07:47:14.944 INFO:scrape:1 jobs: ['5951645'] 2021-03-11T07:47:14.944 INFO:scrape:suites: ['mon_election/classic', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing', 'task/test_orch_cli}'] 2021-03-11T07:47:14.945 INFO:scrape: 2021-03-11T07:47:14.945 INFO:scrape:Crash: Command failed (workunit test rados/test_rados_tool.sh) on smithi076 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_rados_tool.sh' 2021-03-11T07:47:14.946 INFO:scrape:ceph version 16.1.0-630-g87cd59fd (87cd59fd3ebb82c3ebadd5335e99940fbb5394cc) pacific (rc) 1: /lib64/libpthread.so.0(+0x12dc0) [0x7fef7776adc0] 2: gsignal() 3: abort() 4: /lib64/libstdc++.so.6(+0x9006b) [0x7fef76d8d06b] 5: /lib64/libstdc++.so.6(+0x9650c) [0x7fef76d9350c] 6: /lib64/libstdc++.so.6(+0x96567) [0x7fef76d93567] 7: /lib64/libstdc++.so.6(+0x967c8) [0x7fef76d937c8] 8: /lib64/libtcmalloc.so.4(+0x19d24) [0x7fef784d4d24] 9: (tcmalloc::allocate_full_cpp_throw_oom(unsigned long)+0x146) [0x7fef784f70d6] 10: (std::__cxx11::basic_string, std::allocator >::_M_mutate(unsigned long, unsigned long, char const*, unsigned long)+0x6d) [0x558e0936488d] 11: (std::__cxx11::basic_string, std::allocator >::_M_append(char const*, unsigned long)+0x6b) [0x558e09364ccb] 12: (rocksdb::WriteBatchInternal::Put(rocksdb::WriteBatch*, unsigned int, rocksdb::Slice const&, rocksdb::Slice const&)+0x215) [0x558e09f478f5] 13: (rocksdb::WriteBatch::Put(rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::Slice const&)+0x32) [0x558e09f47b32] 14: (RocksDBStore::RocksDBTransactionImpl::put_bat(rocksdb::WriteBatch&, rocksdb::ColumnFamilyHandle*, std::__cxx11::basic_string, std::allocator > const&, ceph::buffer::v15_2_0::list const&)+0x18b) [0x558e09dfe4fb] 15: (RocksDBStore::RocksDBTransactionImpl::set(std::__cxx11::basic_string, std::allocator > const&, std::__cxx11::basic_string, std::allocator > const&, ceph::buffer::v15_2_0::list const&)+0x54) [0x558e09e01fc4] 16: (BlueStore::_omap_setkeys(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, ceph::buffer::v15_2_0::list&)+0x54c) [0x558e098bab6c] 17: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x2336) [0x558e098f2ba6] 18: (BlueStore::queue_transactions(boost::intrusive_ptr&, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x316) [0x558e098f3c26] 19: (non-virtual thunk to PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x58) [0x558e0954fbe8] 20: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xeb0) [0x558e0973d880] 21: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x267) [0x558e0974dbd7] 22: (PGBackend::handle_message(boost::intrusive_ptr)+0x52) [0x558e095835f2] 23: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x5de) [0x558e095268de] 24: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x309) [0x558e093b1279] 25: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x68) [0x558e0960d318] 26: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xa58) [0x558e093d06c8] 27: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x558e09a36fd4] 28: (ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x558e09a39c74] 29: /lib64/libpthread.so.0(+0x82de) [0x7fef777602de] 30: clone() 2021-03-11T07:47:14.946 INFO:scrape:1 jobs: ['5951761'] 2021-03-11T07:47:14.947 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/radostool', 'supported-random-distro$/{centos_8}}'] 2021-03-11T07:47:14.947 INFO:scrape: 2021-03-11T07:47:14.947 INFO:scrape:Failure: Command failed (workunit test mon/pg_autoscaler.sh) on smithi070 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pg_autoscaler.sh' 2021-03-11T07:47:14.948 INFO:scrape:2 jobs: ['5951723', '5951705'] 2021-03-11T07:47:14.948 INFO:scrape:suites intersection: ['rados'] 2021-03-11T07:47:14.949 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/pg-autoscaler-progress-off', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}'] 2021-03-11T07:47:14.949 INFO:scrape: 2021-03-11T07:47:14.950 INFO:scrape:Failure: Command failed (workunit test cephadm/create_iscsi_disks.sh) on smithi106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/cephadm/create_iscsi_disks.sh' 2021-03-11T07:47:14.950 INFO:scrape:4 jobs: ['5951865', '5951530', '5951697', '5951983'] 2021-03-11T07:47:14.951 INFO:scrape:suites intersection: ['task/test_e2e}'] 2021-03-11T07:47:14.951 INFO:scrape:suites union: ['rados/cephadm/dashboard/{0-distro/ubuntu_20.04_kubic_stable', 'rados/cephadm/dashboard/{0-distro/ubuntu_20.04_kubic_testing', 'task/test_e2e}'] 2021-03-11T07:47:14.952 INFO:scrape: 2021-03-11T07:47:14.952 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean. 2021-03-11T07:47:14.953 INFO:scrape:1 jobs: ['5952022'] 2021-03-11T07:47:14.953 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'rados', 'rados/singleton/{all/lost-unfound-delete', 'supported-random-distro$/{rhel_8}}'] 2021-03-11T07:47:14.954 INFO:scrape: 2021-03-11T07:47:14.954 INFO:scrape:Failure: "2021-03-10T20:34:40.013582+0000 mon.a (mon.0) 10 : cluster [WRN] Health check update: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log 2021-03-11T07:47:14.954 INFO:scrape:1 jobs: ['5952024'] 2021-03-11T07:47:14.955 INFO:scrape:suites: ['clusters/{fixed-4', 'mon_election/connectivity', 'msgr-failures/few', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash-erasure-code-shec/{ceph', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}'] 2021-03-11T07:47:14.955 INFO:scrape: 2021-03-11T07:47:14.967 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/ failed: 15 dead: 3 running: 0 waiting: 0 queued: 0 passed: 325 Fail ================================================================= [5951530] rados/cephadm/dashboard/{0-distro/ubuntu_20.04_kubic_stable task/test_e2e} ----------------------------------------------------------------- time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951530/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951530/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab278f0b236b4ad89b0b32647c866e4d Command failed (workunit test cephadm/create_iscsi_disks.sh) on smithi191 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.1/qa/workunits/cephadm/create_iscsi_disks.sh' [5951645] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:15:56 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951645/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951645/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d440974071c49ea81ed903d6254db62 Test failure: test_create_and_delete_export (tasks.cephfs.test_nfs.TestNFS) [5951697] rados/cephadm/dashboard/{0-distro/ubuntu_20.04_kubic_testing task/test_e2e} ----------------------------------------------------------------- time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951697/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951697/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cfa227db6c4e440d92bfcf9480ea0df4 Command failed (workunit test cephadm/create_iscsi_disks.sh) on smithi201 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.1/qa/workunits/cephadm/create_iscsi_disks.sh' [5951705] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:23:07 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951705/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951705/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3b5d4fc095c42b8b6da951c0811f5eb Command failed (workunit test mon/pg_autoscaler.sh) on smithi135 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pg_autoscaler.sh' [5951723] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951723/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951723/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9cd5a8cec0347de92cb027ec39ce9af Command failed (workunit test mon/pg_autoscaler.sh) on smithi070 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pg_autoscaler.sh' [5951761] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:27:37 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951761/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951761/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7bb4bf0c35b54fa99370fe9accf81b87 Command failed (workunit test rados/test_rados_tool.sh) on smithi076 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_rados_tool.sh' [5951855] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_testing 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951855/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951855/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a115fe2202264102ae4d5ce756bfed87 Command failed on smithi028 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:87cd59fd3ebb82c3ebadd5335e99940fbb5394cc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid de0dad40-81d5-11eb-9080-001a4aab830c -- ceph orch host ls --format=json' [5951865] rados/cephadm/dashboard/{0-distro/ubuntu_20.04_kubic_stable task/test_e2e} ----------------------------------------------------------------- time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951865/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951865/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41b5e75c2cdb4c61978ac56758e40750 Command failed (workunit test cephadm/create_iscsi_disks.sh) on smithi106 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.1/qa/workunits/cephadm/create_iscsi_disks.sh' [5951983] rados/cephadm/dashboard/{0-distro/ubuntu_20.04_kubic_testing task/test_e2e} ----------------------------------------------------------------- time: 00:12:37 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951983/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951983/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58873dd674ce4e4d92fc4ea18b9ae1a3 Command failed (workunit test cephadm/create_iscsi_disks.sh) on smithi080 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=af18f5db7a2f7fd441af163239df24e765d7f3ad TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.1/qa/workunits/cephadm/create_iscsi_disks.sh' [5952013] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_stable 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952013/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952013/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0caa7b63810c49b1a513ddbcdc7c1d93 Command failed on smithi174 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:87cd59fd3ebb82c3ebadd5335e99940fbb5394cc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fb53bb0-81df-11eb-9080-001a4aab830c -- ceph orch host ls --format=json' [5952020] rados/cephadm/with-work/{0-distro/ubuntu_20.04_kubic_stable fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952020/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952020/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee487c56f6ad43849cacce01bde1a8e0 Command failed on smithi199 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:87cd59fd3ebb82c3ebadd5335e99940fbb5394cc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88dd262a-81df-11eb-9080-001a4aab830c -- ceph orch host ls --format=json' [5952022] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 01:05:30 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952022/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952022/ Scrubbing terminated -- not all pgs were active and clean. [5952023] rados/cephadm/smoke/{distro/ubuntu_20.04_kubic_stable fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952023/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952023/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99d9e5e38c4841198c3adba6b4f50868 Command failed on smithi120 with status 126: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:87cd59fd3ebb82c3ebadd5335e99940fbb5394cc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 54702608-81df-11eb-9080-001a4aab830c -- ceph orch host ls --format=json' [5952024] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952024/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952024/ "2021-03-10T20:34:40.013582+0000 mon.a (mon.0) 10 : cluster [WRN] Health check update: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log [5952028] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04_kubic_testing start} ----------------------------------------------------------------- time: 00:08:35 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952028/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952028/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d5a58f2d43874432a0112cb2e82bf15c Command failed on smithi160 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:87cd59fd3ebb82c3ebadd5335e99940fbb5394cc shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f12bb976-81df-11eb-9080-001a4aab830c -- ceph orch daemon add mon smithi160:172.21.15.160=smithi160' Dead ================================================================= [5951891] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951891/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951891/ hit max job timeout [5951915] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951915/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951915/ hit max job timeout [5951951] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951951/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951951/ hit max job timeout Pass ================================================================= [5951526] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_testing 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:32:13 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951526/ [5951528] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951528/ [5951532] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:19 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951532/ [5951534] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli random-distro$/{ubuntu_18.04}} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951534/ [5951536] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951536/ [5951538] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:31:37 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951538/ [5951540] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951540/ [5951542] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:30:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951542/ [5951544] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951544/ [5951546] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951546/ [5951548] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:30:00 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951548/ [5951550] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951550/ [5951552] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:15:57 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951552/ [5951554] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951554/ [5951556] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4M_seq_read} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951556/ [5951558] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:45:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951558/ [5951560] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/classic} time: 00:19:15 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951560/ [5951562] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:54 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951562/ [5951564] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:56 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951564/ [5951566] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:26:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951566/ [5951568] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:19:39 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951568/ [5951570] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:36 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951570/ [5951572] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951572/ [5951574] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:14:44 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951574/ [5951576] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951576/ [5951578] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable mon_election/connectivity task/test_cephadm_repos} time: 00:04:58 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951578/ [5951580] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951580/ [5951582] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:16:12 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951582/ [5951584] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951584/ [5951586] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:33:12 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951586/ [5951588] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951588/ [5951590] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:21:38 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951590/ [5951592] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:38:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951592/ [5951594] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951594/ [5951596] rados/cephadm/with-work/{0-distro/ubuntu_20.04_kubic_stable fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:34:30 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951596/ [5951598] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_write} time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951598/ [5951600] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:31:35 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951600/ [5951602] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects} time: 00:24:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951602/ [5951604] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mgr} time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951604/ [5951606] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:29:16 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951606/ [5951608] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951608/ [5951610] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:10:31 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951610/ [5951612] rados/cephadm/smoke/{distro/ubuntu_20.04_kubic_stable fixed-2 mon_election/classic start} time: 00:16:00 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951612/ [5951614] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951614/ [5951616] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04 start} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951616/ [5951618] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951618/ [5951620] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:30:16 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951620/ [5951622] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951622/ [5951624] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:13 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951624/ [5951626] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} time: 00:18:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951626/ [5951628] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951628/ [5951630] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951630/ [5951632] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:24:51 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951632/ [5951633] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} time: 00:56:49 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951633/ [5951636] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/insights} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951636/ [5951637] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_omap_write} time: 00:28:59 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951637/ [5951639] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_testing 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:36:04 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951639/ [5951641] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:58 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951641/ [5951643] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:24:08 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951643/ [5951648] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:38:28 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951648/ [5951650] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951650/ [5951652] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:22:04 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951652/ [5951653] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/misc} time: 00:30:52 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951653/ [5951655] rados/cephadm/with-work/{0-distro/ubuntu_20.04_kubic_testing fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:24:04 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951655/ [5951657] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:06:04 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951657/ [5951659] rados/cephadm/smoke/{distro/ubuntu_20.04_kubic_testing fixed-2 mon_election/connectivity start} time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951659/ [5951661] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:19:43 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951661/ [5951663] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951663/ [5951665] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951665/ [5951667] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:19:42 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951667/ [5951669] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:28:21 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951669/ [5951671] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:21:23 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951671/ [5951673] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:29:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951673/ [5951675] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 01:06:55 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951675/ [5951677] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/sample_fio} time: 00:13:46 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951677/ [5951679] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951679/ [5951681] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:22:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951681/ [5951683] rados/singleton/{all/peer mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951683/ [5951685] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:36:55 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951685/ [5951687] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:14 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951687/ [5951689] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:23:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951689/ [5951691] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:23 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951691/ [5951693] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} time: 00:14:22 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951693/ [5951695] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:15 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951695/ [5951699] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:31:30 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951699/ [5951701] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:40:02 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951701/ [5951703] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951703/ [5951707] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951707/ [5951709] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04_kubic_stable start} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951709/ [5951711] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:47 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951711/ [5951713] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2 mon_election/classic} time: 00:19:34 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951713/ [5951715] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:40 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951715/ [5951717] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 02:14:54 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951717/ [5951719] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951719/ [5951721] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/sample_radosbench} time: 00:09:20 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951721/ [5951725] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing mon_election/classic task/test_adoption} time: 00:07:39 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951725/ [5951727] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951727/ [5951729] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:27:45 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951729/ [5951731] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:33:07 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951731/ [5951733] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:28:19 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951733/ [5951735] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:29:29 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951735/ [5951737] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/many workloads/pool-create-delete} time: 00:19:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951737/ [5951739] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951739/ [5951741] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:06:28 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951741/ [5951743] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:13 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951743/ [5951745] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:17:54 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951745/ [5951747] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951747/ [5951749] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/osd} time: 03:13:07 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951749/ [5951751] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench-high-concurrency} time: 00:37:47 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951751/ [5951753] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:27 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951753/ [5951755] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:20:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951755/ [5951757] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_testing 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:32:14 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951757/ [5951759] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:30 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951759/ [5951763] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable mon_election/connectivity task/test_cephadm} time: 00:16:20 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951763/ [5951765] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951765/ [5951767] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/cosbench_64K_read_write} time: 00:23:19 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951767/ [5951769] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951769/ [5951771] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:35:58 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951771/ [5951773] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:08:22 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951773/ [5951775] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951775/ [5951777] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:22:28 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951777/ [5951779] rados/singleton/{all/random-eio mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:19:44 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951779/ [5951781] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:34:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951781/ [5951783] rados/cephadm/smoke/{distro/ubuntu_20.04_kubic_stable fixed-2 mon_election/connectivity start} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951783/ [5951785] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951785/ [5951787] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:19 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951787/ [5951789] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951789/ [5951791] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04_kubic_testing start} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951791/ [5951793] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/redirect} time: 00:18:05 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951793/ [5951795] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:43:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951795/ [5951797] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:15:57 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951797/ [5951799] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} time: 00:19:20 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951799/ [5951801] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951801/ [5951803] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:29:46 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951803/ [5951805] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/cosbench_64K_write} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951805/ [5951807] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:39:15 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951807/ [5951809] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951809/ [5951811] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:05:55 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951811/ [5951813] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:30:25 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951813/ [5951815] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951815/ [5951817] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951817/ [5951819] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951819/ [5951821] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951821/ [5951823] rados/cephadm/smoke/{distro/ubuntu_20.04_kubic_testing fixed-2 mon_election/classic start} time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951823/ [5951825] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951825/ [5951827] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:16 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951827/ [5951829] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951829/ [5951831] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing mon_election/classic task/test_cephadm_repos} time: 00:05:08 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951831/ [5951833] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951833/ [5951835] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951835/ [5951837] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:17:00 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951837/ [5951839] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:15:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951839/ [5951841] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:09:56 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951841/ [5951843] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951843/ [5951845] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951845/ [5951847] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/crush} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951847/ [5951849] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 05:21:12 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951849/ [5951851] rados/cephadm/with-work/{0-distro/ubuntu_20.04_kubic_stable fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:34:58 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951851/ [5951853] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_read} time: 00:09:59 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951853/ [5951857] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951857/ [5951859] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:44 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951859/ [5951861] rados/singleton/{all/test-crash mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951861/ [5951863] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:18:15 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951863/ [5951867] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951867/ [5951869] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli random-distro$/{ubuntu_20.04_kubic_stable}} time: 00:13:08 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951869/ [5951871] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951871/ [5951873] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951873/ [5951875] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:18:07 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951875/ [5951877] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:23:19 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951877/ [5951879] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:32 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951879/ [5951881] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:21:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951881/ [5951883] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951883/ [5951885] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951885/ [5951887] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951887/ [5951889] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951889/ [5951893] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:15:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951893/ [5951895] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/classic} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951895/ [5951897] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:53 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951897/ [5951899] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4K_rand_rw} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951899/ [5951901] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 01:06:07 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951901/ [5951903] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:07:05 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951903/ [5951905] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:38:35 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951905/ [5951907] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:36:14 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951907/ [5951909] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:24:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951909/ [5951911] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951911/ [5951913] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable mon_election/connectivity task/test_orch_cli} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951913/ [5951917] rados/cephadm/with-work/{0-distro/ubuntu_20.04_kubic_testing fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:23:48 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951917/ [5951919] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects} time: 00:21:45 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951919/ [5951921] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951921/ [5951923] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951923/ [5951925] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951925/ [5951926] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951926/ [5951927] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_stable 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:09:36 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951927/ [5951928] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:22:30 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951928/ [5951929] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:56 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951929/ [5951930] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/fio_4M_rand_read} time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951930/ [5951931] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:19:57 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951931/ [5951932] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:50:02 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951932/ [5951933] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:31:46 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951933/ [5951934] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mgr} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951934/ [5951935] rados/cephadm/smoke/{distro/ubuntu_20.04_kubic_stable fixed-2 mon_election/classic start} time: 00:15:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951935/ [5951936] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951936/ [5951937] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951937/ [5951938] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:21:48 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951938/ [5951939] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04 start} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951939/ [5951940] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951940/ [5951941] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951941/ [5951942] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951942/ [5951943] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:40 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951943/ [5951944] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:16:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951944/ [5951945] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951945/ [5951946] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951946/ [5951947] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:58 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951947/ [5951948] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:46 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951948/ [5951949] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing mon_election/connectivity task/test_adoption} time: 00:07:36 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951949/ [5951950] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951950/ [5951952] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:31:55 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951952/ [5951953] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_rw} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951953/ [5951954] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_testing 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:33:39 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951954/ [5951955] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:29:11 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951955/ [5951956] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951956/ [5951957] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:08:14 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951957/ [5951958] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:05 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951958/ [5951959] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:22:15 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951959/ [5951960] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:21:08 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951960/ [5951961] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:28:35 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951961/ [5951962] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951962/ [5951963] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:14:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951963/ [5951964] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:06:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951964/ [5951965] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:41 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951965/ [5951966] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951966/ [5951967] rados/singleton/{all/deduptool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951967/ [5951968] rados/cephadm/smoke/{distro/ubuntu_20.04_kubic_testing fixed-2 mon_election/connectivity start} time: 00:15:48 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951968/ [5951969] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:30:23 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951969/ [5951970] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable mon_election/classic task/test_cephadm} time: 00:15:57 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951970/ [5951971] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:49 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951971/ [5951972] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/fio_4M_rand_write} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951972/ [5951973] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:41 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951973/ [5951974] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} time: 02:06:26 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951974/ [5951975] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_stable 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:40:03 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951975/ [5951976] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951976/ [5951977] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951977/ [5951978] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951978/ [5951979] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:26 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951979/ [5951980] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:32:02 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951980/ [5951981] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:21:14 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951981/ [5951982] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:25:38 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951982/ [5951984] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:45:13 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951984/ [5951985] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:07:34 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951985/ [5951986] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:28 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951986/ [5951987] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951987/ [5951988] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:24:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951988/ [5951989] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04_kubic_stable start} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951989/ [5951990] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:20:45 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951990/ [5951991] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:16 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951991/ [5951992] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:28:54 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951992/ [5951993] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2 mon_election/classic} time: 00:18:07 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951993/ [5951994] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:07 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951994/ [5951995] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4K_rand_read} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951995/ [5951996] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951996/ [5951997] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:26 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951997/ [5951998] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:33:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951998/ [5951999] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5951999/ [5952000] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:28 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952000/ [5952001] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:31:15 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952001/ [5952002] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/snaps-few-objects} time: 00:38:07 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952002/ [5952003] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:53:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952003/ [5952004] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:14:04 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952004/ [5952005] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:21:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952005/ [5952006] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/insights} time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952006/ [5952007] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952007/ [5952008] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952008/ [5952009] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:18:43 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952009/ [5952010] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing mon_election/connectivity task/test_cephadm_repos} time: 00:04:50 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952010/ [5952011] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952011/ [5952012] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952012/ [5952014] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:05:21 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952014/ [5952015] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4K_seq_read} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952015/ [5952016] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:19:57 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952016/ [5952017] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952017/ [5952018] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 05:08:58 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952018/ [5952019] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:23:06 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952019/ [5952021] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:22:55 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952021/ [5952025] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:52 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952025/ [5952026] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:30:18 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952026/ [5952027] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952027/ [5952029] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952029/ [5952030] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2 mon_election/connectivity} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952030/ [5952031] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/scrub} time: 01:43:35 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952031/ [5952032] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 01:07:24 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952032/ [5952033] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_testing 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 01:09:54 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952033/ [5952034] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/pool-create-delete} time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952034/ [5952035] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952035/ [5952036] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_18.04 workloads/radosbench_4M_rand_read} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952036/ [5952037] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:29:37 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952037/ [5952038] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:32:10 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952038/ [5952039] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:28:10 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952039/ [5952040] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:46 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952040/ [5952041] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} time: 00:51:45 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952041/ [5952042] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:09 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952042/ [5952043] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable mon_election/classic task/test_orch_cli} time: 00:18:33 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952043/ [5952044] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:16 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952044/ [5952045] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952045/ [5952046] rados/cephadm/smoke/{distro/ubuntu_20.04_kubic_testing fixed-2 mon_election/classic start} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952046/ [5952047] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:33:05 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952047/ [5952048] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:30:07 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952048/ [5952049] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} time: 01:26:57 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952049/ [5952050] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache} time: 00:16:26 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952050/ [5952051] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952051/ [5952052] rados/cephadm/with-work/{0-distro/ubuntu_20.04_kubic_testing fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:34:31 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952052/ [5952053] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952053/ [5952054] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/dashboard} time: 01:11:01 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952054/ [5952055] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:06:51 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952055/ [5952056] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:07:22 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952056/ [5952057] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:29:14 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952057/ [5952058] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952058/ [5952059] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952059/ [5952060] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 05:04:11 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952060/ [5952061] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:21:39 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952061/ [5952062] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_18.04 workloads/radosbench_4M_seq_read} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952062/ [5952063] rados/cephadm/thrash/{0-distro/ubuntu_20.04_kubic_stable 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:33:14 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952063/ [5952064] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952064/ [5952065] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:30:37 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952065/ [5952066] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952066/ [5952067] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:23 info: http://pulpito.ceph.com/teuthology-2021-03-10_03:31:01-rados-pacific-distro-basic-smithi/5952067/