2019-11-19T11:05:07.377 INFO:root:teuthology version: 1.0.0-554bd7d 2019-11-19T11:05:07.378 INFO:teuthology.results:subset: '742/9999' 2019-11-19T11:05:07.378 INFO:teuthology.results:seed: '2477' 2019-11-21T04:41:37.820 INFO:root:teuthology version: 1.0.0-0b93d68 2019-11-21T04:41:37.827 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2019-11-21T08:41:43.980 INFO:teuthology.results:Tests finished! gathering results... 2019-11-21T08:41:44.267 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira ================================================================= info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/ failed: 35 dead: 6 running: 0 waiting: 0 queued: 0 passed: 178 Fail ================================================================= [4523460] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{centos_7.yaml} tasks/orchestrator_cli.yaml} ----------------------------------------------------------------- time: 00:21:25 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523460/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523460/ Test failure: test_mon_update (tasks.mgr.test_orchestrator_cli.TestOrchestratorCli) [4523444] rados/objectstore/{backends/objectstore.yaml supported-random-distro$/{centos_7.yaml}} ----------------------------------------------------------------- time: 01:30:34 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523444/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523444/ Command failed on mira105 with status 139: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to- stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug- filestore 20 --debug-bluestore 20" ceph_test_objectstore --gtest_filter=-*/3 --gtest_catch_exceptions=0\'' [4523443] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_striper.yaml} ----------------------------------------------------------------- time: 00:42:13 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523443/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523443/ "2019-11-19T16:34:42.443503+0000 mon.b (mon.0) 32 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log [4523549] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/one.yaml workloads/pool-create-delete.yaml} ----------------------------------------------------------------- time: 00:32:26 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523549/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523549/ failed to reach quorum size 3 before timeout expired [4523568] rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} ----------------------------------------------------------------- time: 00:18:54 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523568/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523568/ Command failed on mira109 with status 1: 'yes | sudo mkfs.xfs -f -i size=2048 -f /dev/sdc' [4523540] rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:32:55 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523540/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523540/ failed to reach quorum size 3 before timeout expired [4523490] rados/multimon/{clusters/6.yaml msgr-failures/few.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_recovery.yaml} ----------------------------------------------------------------- time: 00:16:21 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523490/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523490/ failed to reach quorum size 6 before timeout expired [4523608] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:30:55 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523608/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523608/ failed to reach quorum size 3 before timeout expired [4523570] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} ----------------------------------------------------------------- time: 00:01:42 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523570/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523570/ /python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/ teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/pyt hon2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub")Failure object was: {'mira057.front.sepia.ceph.com': {'msg': u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teutho logy_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teu thology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub")Failure object was: {'mira072.front.sepia.ceph.com': {'msg': u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teutho logy_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teu thology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub") [4523619] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} ----------------------------------------------------------------- time: 00:39:55 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523619/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523619/ Command failed on mira041 with status 6: "sudo ceph --cluster ceph --mon- client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health- to-clog" [4523517] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/snaps-few-objects.yaml} ----------------------------------------------------------------- time: 00:33:36 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523517/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523517/ failed to reach quorum size 9 before timeout expired [4523511] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} ----------------------------------------------------------------- time: 00:11:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523511/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523511/ Command failed on mira109 with status 124: "sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0" [4523435] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} ----------------------------------------------------------------- time: 00:40:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523435/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523435/ Command failed on mira038 with status 6: "sudo ceph --cluster ceph --mon- client-directed-command-retry 5 tell 'mon.*' injectargs -- --no-mon-health- to-clog" [4523439] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_7.yaml} tasks/module_selftest.yaml} ----------------------------------------------------------------- time: 00:23:37 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523439/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523439/ Test failure: test_diskprediction_local (tasks.mgr.test_module_selftest.TestModuleSelftest) [4523596] rados/standalone/{supported-random-distro$/{centos_7.yaml} workloads/mon.yaml} ----------------------------------------------------------------- time: 00:20:57 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523596/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523596/ Command failed (workunit test mon/misc.sh) on mira110 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e64e87aa61e8d0ac330cfcf330630133e43394d0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh' [4523418] rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 03:52:01 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523418/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523418/ Command failed (workunit test cls/test_cls_rbd.sh) on mira063 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e64e87aa61e8d0ac330cfcf330630133e43394d0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh' [4523576] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync-many.yaml workloads/rados_5925.yaml} ----------------------------------------------------------------- time: 00:27:46 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523576/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523576/ failed to reach quorum size 9 before timeout expired [4523574] rados/singleton/{all/pg-autoscaler.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} ----------------------------------------------------------------- time: 00:01:41 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523574/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523574/ /python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/ teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/pyt hon2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub")Failure object was: {'mira066.front.sepia.ceph.com': {'msg': u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teutho logy_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teu thology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub") [4523573] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} ----------------------------------------------------------------- time: 00:00:47 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523573/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523573/ /python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/ teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/pyt hon2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub")Failure object was: {'mira105.front.sepia.ceph.com': {'msg': u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teutho logy_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teu thology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub") [4523572] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-avl.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:01:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523572/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523572/ /python2.7/site-packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/ teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/pyt hon2.7/site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub")Failure object was: {'mira034.front.sepia.ceph.com': {'msg': u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub", '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/__init__.py", line 309, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/__init__.py", line 281, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teutho logy_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 29, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teu thology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u"An unhandled exception occurred while running the lookup plugin 'file'. Error was a , original message: could not locate file in lookup: ~/.cache/src/keys/ssh/smohan.pub") [4523453] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync.yaml workloads/rados_mon_osdmap_prune.yaml} ----------------------------------------------------------------- time: 01:13:10 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523453/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523453/ failed to reach quorum size 9 before timeout expired [4523476] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/mimic.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} ----------------------------------------------------------------- time: 00:23:58 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523476/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523476/ Command crashed: 'CEPH_CLIENT_ID=2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op snap_remove 50 --op snap_create 50 --op rollback 50 --op read 100 --op copy_from 50 --op write 50 --op write_excl 50 --op cache_try_flush 50 --op cache_flush 50 --op cache_evict 50 --op delete 50 --pool base' [4523416] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} ----------------------------------------------------------------- time: 00:20:59 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523416/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523416/ Command failed on mira046 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_cls_rbd --gtest_filter=-TestClsRbd.get_features:TestClsRbd.parents'" [4523471] rados/upgrade/mimic-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/mimic.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-nautilus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml supported-random-distro$/{centos_7.yaml} thrashosds-health.yaml} ----------------------------------------------------------------- time: 00:20:26 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523471/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523471/ Command failed (workunit test cls/test_cls_rbd.sh) on mira069 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=mimic TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rbd.sh' [4523449] rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} ----------------------------------------------------------------- time: 00:17:25 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523449/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523449/ failed to reach quorum size 3 before timeout expired [4523603] rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 06:35:42 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523603/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523603/ Command failed (workunit test rados/test.sh) on mira110 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e64e87aa61e8d0ac330cfcf330630133e43394d0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4523483] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:03:35 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523483/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523483/ mapping node_value = self.represent_data(item_value) File "/home/teuthw orker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 227, in represent_dict return self.represent_mapping(u'tag:yaml.org,2002:map', data) File "/home/teuthwo rker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7 /site-packages/yaml/representer.py", line 125, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/g it.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 68, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site- packages/yaml/representer.py", line 251, in represent_undefined raise RepresenterError("cannot represent an object", data)RepresenterError: ('cannot represent an object', u'force-confdef,force-confold') [4523482] rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 01:07:58 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523482/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523482/ Command failed (workunit test rados/test.sh) on mira041 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e64e87aa61e8d0ac330cfcf330630133e43394d0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4523582] rados/multimon/{clusters/3.yaml msgr-failures/many.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/mon_recovery.yaml} ----------------------------------------------------------------- time: 00:26:40 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523582/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523582/ failed to reach quorum size 3 before timeout expired [4523489] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:32:56 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523489/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523489/ failed to reach quorum size 3 before timeout expired [4523424] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync-many.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:31:42 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523424/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523424/ failed to reach quorum size 3 before timeout expired [4523506] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_omap_write.yaml} ----------------------------------------------------------------- time: 00:28:42 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523506/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523506/ "2019-11-20T05:45:57.891801+0000 mon.a (mon.0) 136 : cluster [WRN] Health check failed: 7 slow ops, oldest one blocked for 71 sec, daemons [osd.1,osd.2] have slow ops. (SLOW_OPS)" in cluster log [4523626] rados/standalone/{supported-random-distro$/{centos_7.yaml} workloads/osd.yaml} ----------------------------------------------------------------- time: 00:24:25 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523626/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523626/ Command failed (workunit test osd/divergent-priors.sh) on mira034 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e64e87aa61e8d0ac330cfcf330630133e43394d0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/divergent-priors.sh' [4523508] rados/singleton-nomsgr/{all/ceph-daemon.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:08:33 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523508/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523508/ Command failed (workunit test test_ceph_daemon.sh) on mira034 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e64e87aa61e8d0ac330cfcf330630133e43394d0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/test_ceph_daemon.sh' [4523623] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_7.yaml} tasks/module_selftest.yaml} ----------------------------------------------------------------- time: 00:24:32 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523623/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523623/ Test failure: test_diskprediction_local (tasks.mgr.test_module_selftest.TestModuleSelftest) Dead ================================================================= [4523467] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523467/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523467/ [4523557] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=clay-k=4-m=2.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523557/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523557/ [4523474] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523474/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523474/ [4523420] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/insights.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523420/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523420/ reached maximum tries (100) after waiting for 600 seconds [4523627] rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523627/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523627/ reached maximum tries (100) after waiting for 600 seconds [4523624] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_7.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523624/ log: http://qa-proxy.ceph.com/teuthology/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523624/ Pass ================================================================= [4523564] rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/misc.yaml} time: 00:25:44 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523564/ [4523528] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/repair_test.yaml} time: 00:26:15 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523528/ [4523566] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} time: 00:19:54 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523566/ [4523567] rados/objectstore/{backends/filestore-idempotent.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:34:20 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523567/ [4523560] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{centos_7.yaml} tasks/crash.yaml} time: 00:20:50 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523560/ [4523561] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} time: 02:39:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523561/ [4523562] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-avl.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 02:27:57 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523562/ [4523529] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/sample_radosbench.yaml} time: 00:16:10 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523529/ [4523569] rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:14:43 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523569/ [4523618] rados/singleton/{all/test-crash.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:10:02 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523618/ [4523563] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} time: 00:50:32 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523563/ [4523551] rados/multimon/{clusters/21.yaml msgr-failures/few.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_with_skews.yaml} time: 00:07:12 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523551/ [4523419] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:34:13 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523419/ [4523553] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/cosbench_64K_write.yaml} time: 00:31:10 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523553/ [4523552] rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 03:10:40 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523552/ [4523555] rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:13:33 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523555/ [4523554] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} time: 00:25:24 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523554/ [4523556] rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:52:50 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523556/ [4523559] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/scrub_test.yaml} time: 00:23:42 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523559/ [4523411] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/rados_python.yaml} time: 00:20:45 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523411/ [4523412] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/fio_4M_rand_read.yaml} time: 00:21:16 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523412/ [4523413] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} time: 00:21:47 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523413/ [4523414] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:38:32 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523414/ [4523415] rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:32:26 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523415/ [4523417] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:12:31 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523417/ [4523527] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} time: 00:37:39 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523527/ [4523481] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:11:47 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523481/ [4523480] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/rados_workunit_loadgen_mix.yaml} time: 00:28:20 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523480/ [4523487] rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 01:03:29 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523487/ [4523486] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4M_seq_read.yaml} time: 00:22:44 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523486/ [4523485] rados/singleton-nomsgr/{all/balancer.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:20:22 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523485/ [4523484] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/progress.yaml} time: 00:14:07 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523484/ [4523488] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} time: 00:30:09 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523488/ [4523548] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rgw_snaps.yaml} time: 00:17:58 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523548/ [4523546] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} time: 00:25:29 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523546/ [4523547] rados/singleton/{all/mon-config.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:15:31 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523547/ [4523544] rados/objectstore/{backends/filestore-idempotent-aio-journal.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:31:57 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523544/ [4523545] rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:12:40 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523545/ [4523542] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/workunits.yaml} time: 00:09:04 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523542/ [4523543] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp.yaml supported-random-distro$/{rhel_7.yaml} tasks/dashboard.yaml} time: 01:03:16 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523543/ [4523541] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:37:59 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523541/ [4523622] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4K_rand_read.yaml} time: 00:23:23 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523622/ [4523491] rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:01 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523491/ [4523492] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} time: 00:28:47 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523492/ [4523493] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} time: 00:17:40 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523493/ [4523494] rados/objectstore/{backends/ceph_objectstore_tool.yaml supported-random-distro$/{centos_7.yaml}} time: 00:25:56 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523494/ [4523495] rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:19:56 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523495/ [4523496] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/radosbench_4M_write.yaml} time: 00:15:44 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523496/ [4523497] rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 01:27:57 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523497/ [4523498] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/rados_workunit_loadgen_mostlyread.yaml} time: 00:36:15 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523498/ [4523499] rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/erasure-code.yaml} time: 00:34:34 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523499/ [4523539] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-avl.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:13:28 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523539/ [4523538] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/cosbench_64K_read_write.yaml} time: 00:31:31 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523538/ [4523533] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} time: 00:45:23 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523533/ [4523532] rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/mgr.yaml} time: 00:09:55 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523532/ [4523531] rados/singleton/{all/mon-config-key-caps.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:11:03 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523531/ [4523530] rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:11:54 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523530/ [4523537] rados/singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:19:19 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523537/ [4523536] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} time: 00:38:43 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523536/ [4523535] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-avl.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} time: 00:28:38 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523535/ [4523534] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:14:16 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523534/ [4523579] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:54:35 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523579/ [4523571] rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} time: 00:22:26 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523571/ [4523425] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} time: 00:35:43 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523425/ [4523427] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache.yaml} time: 00:26:51 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523427/ [4523426] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/fio_4M_rand_rw.yaml} time: 00:15:58 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523426/ [4523421] rados/objectstore/{backends/objectcacher-stress.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:35:17 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523421/ [4523423] rados/singleton/{all/thrash-backfill-full.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:54:55 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523423/ [4523422] rados/singleton-nomsgr/{all/osd_stale_reads.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:28:29 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523422/ [4523625] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 02:28:23 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523625/ [4523429] rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:24:34 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523429/ [4523428] rados/multimon/{clusters/21.yaml msgr-failures/few.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/mon_clock_no_skews.yaml} time: 00:13:16 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523428/ [4523621] rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:20:31 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523621/ [4523620] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/dedup_tier.yaml} time: 00:26:13 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523620/ [4523447] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/radosbench_4K_rand_read.yaml} time: 00:18:58 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523447/ [4523446] rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:37 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523446/ [4523445] rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:37:43 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523445/ [4523442] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} time: 00:29:49 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523442/ [4523441] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:24:24 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523441/ [4523440] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} time: 00:28:01 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523440/ [4523520] rados/objectstore/{backends/filejournal.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:19 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523520/ [4523521] rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:19:42 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523521/ [4523522] rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:19:23 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523522/ [4523523] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-avl.yaml supported-random-distro$/{centos_7.yaml} tasks/ssh_orchestrator.yaml} time: 00:14:07 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523523/ [4523524] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} time: 00:20:20 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523524/ [4523525] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:38:38 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523525/ [4523526] rados/singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:23:10 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523526/ [4523448] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} time: 00:39:53 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523448/ [4523628] rados/singleton/{all/thrash-backfill-full.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:57:40 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523628/ [4523432] rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:08:09 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523432/ [4523433] rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:27:06 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523433/ [4523430] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_stress_watch.yaml} time: 00:29:34 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523430/ [4523431] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_7.yaml} tasks/dashboard.yaml} time: 01:08:27 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523431/ [4523436] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/fio_4M_rand_write.yaml} time: 00:14:39 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523436/ [4523437] rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/scrub.yaml} time: 01:12:38 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523437/ [4523434] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/dedup_tier.yaml} time: 00:12:55 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523434/ [4523438] rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:24:08 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523438/ [4523454] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/mimic-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} time: 00:24:05 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523454/ [4523455] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} time: 00:34:35 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523455/ [4523456] rados/multimon/{clusters/3.yaml msgr-failures/many.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_with_skews.yaml} time: 00:06:55 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523456/ [4523457] rados/singleton-nomsgr/{all/version-number-sanity.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:19:01 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523457/ [4523450] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} time: 03:25:19 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523450/ [4523451] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:29:15 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523451/ [4523452] rados/singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:19:30 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523452/ [4523458] rados/singleton/{all/deduptool.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:14:44 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523458/ [4523459] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4K_seq_read.yaml} time: 02:25:10 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523459/ [4523609] rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:15:33 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523609/ [4523550] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/hammer.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} time: 00:47:42 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523550/ [4523601] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} time: 00:24:37 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523601/ [4523600] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous-v1only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_latest.yaml} msgr-failures/few.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} time: 00:21:21 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523600/ [4523602] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:19:12 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523602/ [4523605] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{centos_7.yaml} tasks/insights.yaml} time: 00:17:34 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523605/ [4523604] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:32:23 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523604/ [4523607] rados/singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:41:38 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523607/ [4523606] rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:14:52 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523606/ [4523461] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_workunit_loadgen_big.yaml} time: 00:42:41 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523461/ [4523463] rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:12 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523463/ [4523462] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} time: 00:42:43 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523462/ [4523465] rados/objectstore/{backends/alloc-hint.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:08:31 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523465/ [4523464] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-avl.yaml supported-random-distro$/{centos_7.yaml} tasks/dashboard.yaml} time: 01:08:08 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523464/ [4523466] rados/rest/{mgr-restful.yaml supported-random-distro$/{centos_7.yaml}} time: 00:14:59 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523466/ [4523469] rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:19:07 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523469/ [4523468] rados/singleton-flat/valgrind-leaks.yaml time: 00:22:06 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523468/ [4523558] rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:25:00 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523558/ [4523616] rados/objectstore/{backends/keyvaluedb.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:17:12 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523616/ [4523617] rados/singleton-nomsgr/{all/msgr.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:23:26 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523617/ [4523614] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} time: 00:40:52 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523614/ [4523615] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} time: 00:47:21 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523615/ [4523599] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/fio_4M_rand_rw.yaml} time: 00:09:36 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523599/ [4523598] rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:17:38 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523598/ [4523610] rados/multimon/{clusters/6.yaml msgr-failures/few.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_no_skews.yaml} time: 00:07:17 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523610/ [4523611] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/fio_4M_rand_write.yaml} time: 00:09:14 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523611/ [4523595] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:26:40 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523595/ [4523594] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} time: 00:22:15 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523594/ [4523597] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} tasks/rados_cls_all.yaml} time: 00:18:29 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523597/ [4523591] rados/singleton-nomsgr/{all/lazy_omap_stats_output.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:14:27 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523591/ [4523590] rados/objectstore/{backends/fusestore.yaml supported-random-distro$/{centos_7.yaml}} time: 00:11:52 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523590/ [4523593] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} time: 02:40:31 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523593/ [4523592] rados/singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 02:31:39 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523592/ [4523515] rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:19:36 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523515/ [4523514] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/readwrite.yaml} time: 02:29:27 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523514/ [4523516] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} time: 00:17:42 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523516/ [4523510] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} time: 00:22:29 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523510/ [4523513] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:31:30 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523513/ [4523512] rados/verify/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} time: 00:14:53 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523512/ [4523519] rados/multimon/{clusters/9.yaml msgr-failures/many.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_no_skews.yaml} time: 00:08:33 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523519/ [4523518] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/sample_fio.yaml} time: 00:15:33 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523518/ [4523577] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_api_tests.yaml} time: 00:23:47 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523577/ [4523575] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/fio_4K_rand_rw.yaml} time: 00:09:36 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523575/ [4523629] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} tasks/rados_stress_watch.yaml} time: 00:28:47 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523629/ [4523478] rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:15:03 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523478/ [4523479] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} time: 00:23:19 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523479/ [4523477] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/redirect.yaml} time: 00:26:01 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523477/ [4523475] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 02:27:48 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523475/ [4523472] rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:19:42 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523472/ [4523473] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/radosbench_4M_rand_read.yaml} time: 00:22:52 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523473/ [4523470] rados/standalone/{supported-random-distro$/{centos_7.yaml} workloads/crush.yaml} time: 00:16:14 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523470/ [4523578] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{centos_7.yaml} tasks/dashboard.yaml} time: 01:08:14 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523578/ [4523612] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache.yaml} time: 00:21:36 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523612/ [4523613] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_python.yaml} time: 00:19:11 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523613/ [4523588] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} time: 00:43:19 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523588/ [4523589] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{rhel_7.yaml} workloads/fio_4M_rand_read.yaml} time: 00:20:52 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523589/ [4523565] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml supported-random-distro$/{centos_7.yaml} workloads/fio_4K_rand_read.yaml} time: 00:14:37 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523565/ [4523583] rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:12:57 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523583/ [4523580] rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml supported-random-distro$/{centos_7.yaml}} time: 00:14:05 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523580/ [4523581] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/nautilus.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-octopus.yaml 8-workload/{rbd-python.yaml rgw-swift.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashosds-health.yaml} time: 01:47:43 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523581/ [4523586] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_latest.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} time: 00:33:30 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523586/ [4523587] rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:24:15 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523587/ [4523584] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} time: 00:33:35 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523584/ [4523585] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{centos_7.yaml} tasks/failover.yaml} time: 00:19:12 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523585/ [4523502] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} time: 00:42:47 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523502/ [4523503] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:13:45 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523503/ [4523500] rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:59:43 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523500/ [4523501] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{rhel_7.yaml} tasks/prometheus.yaml} time: 00:22:07 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523501/ [4523507] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} time: 00:47:24 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523507/ [4523504] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/fastclose.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunk-promote-flush.yaml} time: 00:25:25 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523504/ [4523505] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} time: 00:19:54 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523505/ [4523509] rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml}} time: 00:19:28 info: http://pulpito.ceph.com/kchai-2019-11-19_09:56:38-rados-wip-kefu2-testing-2019-11-19-1509-distro-basic-mira/4523509/ 2019-11-21T08:41:44.450 INFO:teuthology.results:starting coverage generation