2020-05-15T02:34:32.730 INFO:root:teuthology version: 1.0.0-ff173f9 2020-05-15T02:34:32.732 INFO:teuthology.results:subset: '814/9999' 2020-05-15T02:34:32.732 INFO:teuthology.results:seed: '2477' 2020-05-15T13:50:06.602 INFO:root:teuthology version: 1.0.0-6ae8e56 2020-05-15T13:50:06.617 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-16T01:50:34.962 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2020-05-16T01:50:35.182 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/ failed: 13 dead: 36 running: 1 waiting: 0 queued: 0 passed: 86 Fail ================================================================= [5055216] rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:16:44 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055216/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055216/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e3c2f1f7aa5b4641955f179322d19e2c Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi074 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2072b2cf276c3666f8002c1c445130ad526c7176 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [5055230] rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 11:53:14 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055230/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055230/ psutil.NoSuchProcess process no longer exists (pid=32134) [5055252] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/module_selftest.yaml} ----------------------------------------------------------------- time: 00:09:40 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055252/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055252/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=240291a8e9994e0789dd867f8b274f20 Test failure: test_diskprediction_local (tasks.mgr.test_module_selftest.TestModuleSelftest) [5055258] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 01:14:30 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055258/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055258/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f5101ac22e4346208968651b8329cdaa Command failed (workunit test cls/test_cls_2pc_queue.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2072b2cf276c3666f8002c1c445130ad526c7176 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cls/test_cls_2pc_queue.sh' [5055271] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/on.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} ----------------------------------------------------------------- time: 00:23:51 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055271/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055271/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=710e87efb36e42a2a3f7d658563385d3 reached maximum tries (180) after waiting for 180 seconds [5055280] rados/objectstore/{backends/objectstore.yaml supported-random-distro$/{centos_8.yaml}} ----------------------------------------------------------------- time: 02:01:34 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055280/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055280/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b8107a9a21534b0fae77376ed1b2a8ed Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-filestore 20 --debug- bluestore 20" ceph_test_objectstore --gtest_filter=-*/3 --gtest_catch_exceptions=0\'' [5055294] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/nautilus.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-octopus.yaml 8-workload/{rbd-python.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml thrashosds-health.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:03:19 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055294/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055294/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5c328f42c5e04773b4cc4ac8c3a65124 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref= nautilus [5055308] rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:07:21 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055308/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055308/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e508a1ef5b214983a1cc9c917acb90c3 Command failed on smithi085 with status 1: "sudo bash -c 'echo 0 > /tmp/python-ceph-brx'" [5055309] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 01:11:16 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055309/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055309/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=70f0d29ff2754c09ab91d8a5e7923c84 Command failed (workunit test cls/test_cls_2pc_queue.sh) on smithi071 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2072b2cf276c3666f8002c1c445130ad526c7176 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cls/test_cls_2pc_queue.sh' [5055315] rados/cephadm/smoke-roleless/{distro/centos_latest.yaml start.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055315/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055315/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=701af38290604bb08f6294402cebed44 Command failed on smithi124 with status 1: 'sudo yum install -y kernel' [5055317] rados/cephadm/workunits/{distro/ubuntu_latest.yaml task/test_cephadm_repos.yaml} ----------------------------------------------------------------- time: 00:03:29 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055317/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055317/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a36ef8e0ae0e42f4bf35947a8a566b76 Command failed (workunit test cephadm/test_repos.sh) on smithi203 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2072b2cf276c3666f8002c1c445130ad526c7176 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [5055322] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_8.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055322/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055322/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d83c34502ed54c779c0bd77573b7657e Command failed on smithi093 with status 1: 'sudo yum install -y kernel' [5055331] rados/multimon/{clusters/9.yaml msgr-failures/few.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_no_skews.yaml} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055331/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055331/ "2020-05-15T13:58:31.680497+0000 mon.c (mon.0) 23 : cluster [WRN] Health check failed: 1/9 mons down, quorum c,a,b,f,d,e,i,g (MON_DOWN)" in cluster log Dead ================================================================= [5055212] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 00:51:22 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055212/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055212/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f5c2eda2396442cb9063000828883a81 Test failure: setUpClass (tasks.mgr.dashboard.test_cluster_configuration.ClusterConfigurationTest) [5055213] rados/objectstore/{backends/filestore-idempotent.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055213/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055213/ [5055217] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:36:29 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055217/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055217/ SSH connection to smithi136 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no- omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0' [5055219] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} ----------------------------------------------------------------- time: 00:51:23 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055219/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055219/ [Errno 113] No route to host [5055223] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_mix.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055223/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055223/ [5055226] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 00:36:32 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055226/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055226/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b4638febfddb4c199469f6a65777fd90 Test failure: setUpClass (tasks.mgr.dashboard.test_host.HostControllerTest) [5055228] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_omap_write.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055228/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055228/ [5055231] rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/mon.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055231/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055231/ [5055232] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/on.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects-localized.yaml} ----------------------------------------------------------------- time: 00:37:18 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055232/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055232/ SSH connection to smithi039 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --localize-reads --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0' [5055234] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055234/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055234/ [5055236] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_mostlyread.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055236/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055236/ [5055241] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055241/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055241/ [5055244] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:51:33 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055244/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055244/ [Errno 113] No route to host [5055253] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/on.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055253/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055253/ [5055255] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/cosbench_64K_read_write.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055255/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055255/ [5055256] rados/cephadm/workunits/{distro/ubuntu_latest.yaml task/test_cephadm.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055256/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055256/ [5055259] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:36:29 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055259/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055259/ SSH connection to smithi200 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no- omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0' [5055260] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/cosbench_64K_write.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055260/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055260/ [5055261] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 00:52:04 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055261/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055261/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=69dd04203a77401f9e6917d90610e102 Test failure: setUpClass (tasks.mgr.dashboard.test_host.HostControllerTest) [5055262] rados/objectstore/{backends/objectcacher-stress.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055262/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055262/ [5055263] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/on.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055263/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055263/ [5055265] rados/cephadm/with-work/{distro/ubuntu_latest.yaml fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml tasks/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055265/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055265/ [5055266] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055266/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055266/ [5055272] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} ----------------------------------------------------------------- time: 00:36:12 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055272/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055272/ SSH connection to smithi159 was lost: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no- omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0' [5055273] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055273/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055273/ [5055279] rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055279/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055279/ [5055287] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} ----------------------------------------------------------------- time: 00:36:42 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055287/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055287/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=39295131e71247cabde7b5ad46178d36 SSH connection to smithi101 was lost: "/bin/sh -c 'adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 -p unique_pool_2 bench 150 write'" [5055288] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055288/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055288/ [5055296] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055296/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055296/ [5055302] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:36:01 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055302/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055302/ Unable to open channel. [5055306] rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055306/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055306/ [5055320] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 00:51:30 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055320/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055320/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3fdb6bf4b8fc432c973a6ad1be492356 Test failure: setUpClass (tasks.mgr.dashboard.test_host.HostControllerTest) [5055323] rados/cephadm/with-work/{distro/ubuntu_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_python.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055323/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055323/ [5055325] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055325/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055325/ [5055336] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055336/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055336/ [5055343] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055343/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055343/ Running ================================================================= [5055339] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_omap_write.yaml} info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055339/ Pass ================================================================= [5055211] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/many.yaml workloads/rados_5925.yaml} time: 00:18:13 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055211/ [5055214] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-hybrid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} time: 00:33:57 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055214/ [5055215] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_seq_read.yaml} time: 00:18:31 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055215/ [5055218] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects-localized.yaml} time: 00:22:31 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055218/ [5055220] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/on.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/small-objects.yaml} time: 00:25:24 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055220/ [5055221] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_write.yaml} time: 00:10:30 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055221/ [5055222] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:11:08 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055222/ [5055224] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/mimic.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} time: 00:36:54 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055224/ [5055225] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_8.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:10:52 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055225/ [5055227] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} time: 00:21:00 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055227/ [5055229] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:32:56 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055229/ [5055233] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} time: 00:23:08 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055233/ [5055235] rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:08:47 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055235/ [5055237] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:14:16 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055237/ [5055238] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} time: 00:33:32 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055238/ [5055239] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/sample_fio.yaml} time: 00:12:13 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055239/ [5055240] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/insights.yaml} time: 00:11:51 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055240/ [5055242] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} time: 00:27:44 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055242/ [5055243] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} time: 00:21:43 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055243/ [5055245] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/sample_radosbench.yaml} time: 00:09:44 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055245/ [5055246] rados/cephadm/smoke-roleless/{distro/centos_latest.yaml start.yaml} time: 00:10:14 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055246/ [5055247] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} time: 00:17:16 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055247/ [5055248] rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:08:40 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055248/ [5055249] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/readwrite.yaml} time: 00:11:14 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055249/ [5055250] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} time: 00:33:33 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055250/ [5055251] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:11:32 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055251/ [5055254] rados/standalone/{supported-random-distro$/{rhel_8.yaml} workloads/osd.yaml} time: 02:33:29 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055254/ [5055257] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} time: 00:31:39 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055257/ [5055264] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:11:25 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055264/ [5055267] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} time: 00:26:07 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055267/ [5055268] rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:31 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055268/ [5055269] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4K_rand_read.yaml} time: 00:12:51 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055269/ [5055270] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} time: 00:27:32 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055270/ [5055274] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/scrub_test.yaml} time: 00:09:51 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055274/ [5055275] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} time: 00:30:04 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055275/ [5055276] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4K_rand_rw.yaml} time: 00:13:56 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055276/ [5055277] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} time: 00:22:14 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055277/ [5055278] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-hybrid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:13:44 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055278/ [5055281] rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:12:18 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055281/ [5055282] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_api_tests.yaml} time: 00:25:37 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055282/ [5055283] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4M_rand_read.yaml} time: 00:10:19 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055283/ [5055284] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:10:59 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055284/ [5055285] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/dedup_tier.yaml} time: 00:12:44 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055285/ [5055286] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:34:29 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055286/ [5055289] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:11:29 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055289/ [5055290] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/on.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} time: 00:29:18 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055290/ [5055291] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4M_rand_rw.yaml} time: 00:10:25 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055291/ [5055292] rados/singleton/{all/mon-config-key-caps.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:08:53 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055292/ [5055293] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/workunits.yaml} time: 00:07:50 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055293/ [5055295] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} time: 00:22:47 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055295/ [5055297] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} time: 00:29:08 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055297/ [5055298] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} time: 00:22:16 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055298/ [5055299] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4M_rand_write.yaml} time: 00:10:56 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055299/ [5055300] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/one.yaml workloads/rados_5925.yaml} time: 00:08:39 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055300/ [5055301] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/on.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} time: 00:38:41 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055301/ [5055303] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-small-objects-balanced.yaml} time: 00:21:40 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055303/ [5055304] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} time: 01:22:38 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055304/ [5055305] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4K_rand_read.yaml} time: 00:11:29 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055305/ [5055307] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} time: 00:25:10 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055307/ [5055310] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/sync-many.yaml workloads/rados_api_tests.yaml} time: 00:28:12 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055310/ [5055311] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4K_seq_read.yaml} time: 00:10:01 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055311/ [5055312] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} time: 00:13:09 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055312/ [5055313] rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:13 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055313/ [5055314] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:10:43 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055314/ [5055316] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} time: 00:21:02 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055316/ [5055318] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/on.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} time: 00:11:55 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055318/ [5055319] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_rand_read.yaml} time: 00:11:33 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055319/ [5055321] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/set-chunk-promote-flush.yaml} time: 00:11:55 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055321/ [5055324] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_seq_read.yaml} time: 00:10:06 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055324/ [5055326] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:23:49 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055326/ [5055327] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} time: 00:35:16 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055327/ [5055328] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/mimic-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/on.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} time: 00:33:09 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055328/ [5055329] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} time: 00:24:10 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055329/ [5055330] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/small-objects-balanced.yaml} time: 00:25:13 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055330/ [5055332] rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:13:45 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055332/ [5055333] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_write.yaml} time: 00:09:33 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055333/ [5055334] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/on.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/small-objects-localized.yaml} time: 00:27:09 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055334/ [5055335] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-hybrid.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} time: 00:46:18 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055335/ [5055337] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:10:46 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055337/ [5055338] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:31:09 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055338/ [5055340] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/small-objects.yaml} time: 00:22:59 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055340/ [5055341] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/mimic.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} time: 01:45:22 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055341/ [5055342] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{rhel_8.yaml} tasks/module_selftest.yaml} time: 00:29:27 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055342/ [5055344] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/sample_fio.yaml} time: 00:13:36 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055344/ [5055345] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects-localized.yaml} time: 00:35:55 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055345/ [5055346] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} time: 00:27:54 info: http://pulpito.ceph.com/kchai-2020-05-15_02:32:37-rados-wip-kefu-testing-2020-05-15-0016-distro-basic-smithi/5055346/ 2020-05-16T01:50:35.284 INFO:teuthology.results:starting coverage generation 2020-05-16T01:50:35.298 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'