2020-06-28T15:28:31.475 INFO:root:teuthology version: 1.0.0-22bcea5 2020-06-28T15:28:31.478 INFO:teuthology.results:subset: '20/9999' 2020-06-28T15:28:31.478 INFO:teuthology.results:seed: '2980' 2020-06-28T17:18:49.443 INFO:root:teuthology version: 1.0.0-22bcea5 2020-06-28T17:18:49.478 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-06-29T05:00:11.716 INFO:teuthology.results:Tests finished! gathering results... 2020-06-29T05:00:39.344 INFO:scrape:Found 308 jobs 2020-06-29T05:00:53.864 INFO:scrape:Found 9 distinct failure reasons 2020-06-29T05:00:53.866 INFO:scrape:Dead: b'2020-06-29T04:57:12.906 DEBUG:teuthology.exit:Finished running handlers' 2020-06-29T05:00:53.867 INFO:scrape:1 jobs: ['5186096'] 2020-06-29T05:00:53.867 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'd-balancer/on', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/none', 'thrashosds-health', 'workloads/cache-snaps-balanced}'] 2020-06-29T05:00:53.867 INFO:scrape: 2020-06-29T05:00:53.868 INFO:scrape:Failure: Command failed on smithi174 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh' 2020-06-29T05:00:53.868 INFO:scrape:4 jobs: ['5186109', '5186127', '5185883', '5185859'] 2020-06-29T05:00:53.869 INFO:scrape:suites intersection: ['openstack', 'rados/perf/{ceph', 'settings/optimized', 'ubuntu_latest'] 2020-06-29T05:00:53.869 INFO:scrape:suites union: ['objectstore/bluestore-basic-min-osd-mem-target', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-stupid', 'openstack', 'rados/perf/{ceph', 'settings/optimized', 'ubuntu_latest', 'workloads/cosbench_64K_read_write}', 'workloads/cosbench_64K_write}'] 2020-06-29T05:00:53.870 INFO:scrape: 2020-06-29T05:00:53.870 INFO:scrape:Failure: Scrubbing terminated -- not all pgs were active and clean. 2020-06-29T05:00:53.871 INFO:scrape:2 jobs: ['5185874', '5186154'] 2020-06-29T05:00:53.871 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'msgr/async-v2only', 'openstack}', 'rados'] 2020-06-29T05:00:53.871 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/verify/{centos_latest', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_api_tests', 'tasks/rados_python}', 'thrashosds-health}', 'validater/valgrind}'] 2020-06-29T05:00:53.872 INFO:scrape: 2020-06-29T05:00:53.872 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-06-29T05:00:53.873 INFO:scrape:5 jobs: ['5185991', '5186120', '5185959', '5186024', '5185907'] 2020-06-29T05:00:53.873 INFO:scrape:suites intersection: ['ceph', 'rados', 'thrashosds-health'] 2020-06-29T05:00:53.874 INFO:scrape:suites union: ['1-install/luminous', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{centos_7.6}', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2020-06-29T05:00:53.874 INFO:scrape: 2020-06-29T05:00:53.874 INFO:scrape:Failure: "2020-06-28T16:00:00.000163+0000 mon.b (mon.0) 177 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive, 1 pg peering" in cluster log 2020-06-29T05:00:53.875 INFO:scrape:4 jobs: ['5185850', '5185853', '5186122', '5186153'] 2020-06-29T05:00:53.875 INFO:scrape:suites intersection: ['rados'] 2020-06-29T05:00:53.876 INFO:scrape:suites union: ['clusters/{fixed-2', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/multimon/{clusters/21', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/mon_clock_no_skews}', 'tasks/rados_cls_all}'] 2020-06-29T05:00:53.876 INFO:scrape: 2020-06-29T05:00:53.876 INFO:scrape:Failure: "2020-06-28T16:36:40.865507+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request osd_op(client.4157.0:1 1.0 1.5b6a9aab (undecoded) ondisk+read+known_if_redirected e9) initiated 2020-06-28T16:36:10.450886+0000 currently delayed" in cluster log 2020-06-29T05:00:53.877 INFO:scrape:1 jobs: ['5186003'] 2020-06-29T05:00:53.877 INFO:scrape:suites: ['debug/mgr', 'objectstore/bluestore-comp-zstd', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2020-06-29T05:00:53.878 INFO:scrape: 2020-06-29T05:00:53.878 INFO:scrape:Failure: Command failed (workunit test osd/osd-backfill-recovery-log.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5ccfc2d5d3a03d700cf9c4a48b194d7836328981 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-recovery-log.sh' 2020-06-29T05:00:53.879 INFO:scrape:1 jobs: ['5186087'] 2020-06-29T05:00:53.879 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{centos_8}', 'workloads/osd}'] 2020-06-29T05:00:53.879 INFO:scrape: 2020-06-29T05:00:53.880 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi077 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5ccfc2d5d3a03d700cf9c4a48b194d7836328981 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2020-06-29T05:00:53.880 INFO:scrape:1 jobs: ['5185990'] 2020-06-29T05:00:53.881 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2020-06-29T05:00:53.881 INFO:scrape: 2020-06-29T05:00:53.881 INFO:scrape:Failure: wait_for_clean: failed before timeout expired 2020-06-29T05:00:53.882 INFO:scrape:2 jobs: ['5185948', '5185924'] 2020-06-29T05:00:53.882 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'openstack}', 'rados', 'thrashosds-health'] 2020-06-29T05:00:53.883 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'd-balancer/on', 'fast/fast', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/fastread', 'thrashosds-health', 'workloads/ec-small-objects-overwrites}', 'workloads/redirect_promote_tests}'] 2020-06-29T05:00:53.883 INFO:scrape: 2020-06-29T05:00:53.896 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/ failed: 20 dead: 1 running: 0 waiting: 0 queued: 0 passed: 287 Fail ================================================================= [5185850] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:40:40 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185850/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185850/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fb6759ebaf274583be25a25d0d68d46f "2020-06-28T16:00:00.000163+0000 mon.b (mon.0) 177 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive, 1 pg peering" in cluster log [5185853] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:40:51 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185853/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185853/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=92d213ec18f3460a88665a34093db1ef "2020-06-28T15:40:59.988570+0000 mon.a (mon.0) 92 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY)" in cluster log [5185859] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} ----------------------------------------------------------------- time: 00:06:48 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185859/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185859/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6690cac0ddac4922bb7e5911056eeb49 Command failed on smithi014 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh' [5185874] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:54:59 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185874/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185874/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=23f6c64aa1ed4bae9109df3d81244ad5 Scrubbing terminated -- not all pgs were active and clean. [5185883] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} ----------------------------------------------------------------- time: 00:06:46 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185883/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185883/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5de17e11d8744bf2b9c93c289e134166 Command failed on smithi014 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh' [5185907] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 01:16:20 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185907/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185907/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5b0d315a30754ed0918f727df5092458 reached maximum tries (500) after waiting for 3000 seconds [5185924] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_promote_tests} ----------------------------------------------------------------- time: 01:05:25 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185924/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185924/ wait_for_recovery: failed before timeout expired [5185948] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:29:19 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185948/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185948/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e0f39ae2fbf04aee84d96dd4e99262fe wait_for_clean: failed before timeout expired [5185959] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:25:08 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185959/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185959/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c15ee3b974294583b60a25a34def74b3 reached maximum tries (180) after waiting for 180 seconds [5185990] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 05:20:33 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185990/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185990/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e437cd3711504b77a89da288b44df1f9 Command failed (workunit test rados/test.sh) on smithi077 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5ccfc2d5d3a03d700cf9c4a48b194d7836328981 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5185991] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:24:30 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185991/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185991/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=aea5c7cb978f4289a1fa94b40d876ab8 reached maximum tries (180) after waiting for 180 seconds [5186003] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:26:44 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186003/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186003/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5d514a1817da4a78bc03dd64ffa022c9 "2020-06-28T16:36:40.865507+0000 osd.1 (osd.1) 3 : cluster [WRN] slow request osd_op(client.4157.0:1 1.0 1.5b6a9aab (undecoded) ondisk+read+known_if_redirected e9) initiated 2020-06-28T16:36:10.450886+0000 currently delayed" in cluster log [5186024] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:24:54 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186024/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186024/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fc3fcf20f4474737849fc778116f7841 reached maximum tries (180) after waiting for 180 seconds [5186087] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} ----------------------------------------------------------------- time: 00:35:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186087/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186087/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f704093c73ac4ae18d289ab0a5ebf431 Command failed (workunit test osd/osd-backfill-recovery-log.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5ccfc2d5d3a03d700cf9c4a48b194d7836328981 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill- recovery-log.sh' [5186109] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} ----------------------------------------------------------------- time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186109/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186109/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3148c1b5a49e43c78bd3c87905562db5 Command failed on smithi174 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh' [5186120] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:25:12 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186120/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186120/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=982a5488f9fd45fe8dd8ca111c79a629 reached maximum tries (180) after waiting for 180 seconds [5186122] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:06:56 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186122/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186122/ "2020-06-28T17:17:18.306833+0000 mon.b (mon.0) 21 : cluster [WRN] Health check failed: 1/21 mons down, quorum b,c,a,e,f,d,h,i,g,k,l,j,n,o,q,r,p,t,u,s (MON_DOWN)" in cluster log [5186127] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} ----------------------------------------------------------------- time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186127/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186127/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fd98325b9539487c86e91354aacc77bc Command failed on smithi073 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh' [5186153] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:28:49 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186153/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186153/ "2020-06-28T17:31:29.556053+0000 mon.a (mon.0) 102 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY)" in cluster log [5186154] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} ----------------------------------------------------------------- time: 00:40:32 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186154/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186154/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2491e23d842d4ef084ed15ffa05d0aa6 Scrubbing terminated -- not all pgs were active and clean. Dead ================================================================= [5186096] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186096/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186096/ Pass ================================================================= [5185851] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185851/ [5185852] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185852/ [5185854] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:25:53 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185854/ [5185855] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185855/ [5185856] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:32:03 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185856/ [5185857] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/dedup_tier} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185857/ [5185858] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/crash} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185858/ [5185860] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:35:30 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185860/ [5185861] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:25:40 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185861/ [5185862] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185862/ [5185863] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:33:20 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185863/ [5185864] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:01:17 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185864/ [5185865] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:15:24 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185865/ [5185866] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185866/ [5185867] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_8}} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185867/ [5185868] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:12:58 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185868/ [5185869] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} time: 03:54:43 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185869/ [5185870] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:22:41 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185870/ [5185871] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 01:13:01 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185871/ [5185872] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_5925} time: 00:08:18 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185872/ [5185873] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:26 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185873/ [5185875] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185875/ [5185876] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:30:05 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185876/ [5185877] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185877/ [5185878] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:31:58 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185878/ [5185879] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:21:25 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185879/ [5185880] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:13 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185880/ [5185881] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185881/ [5185882] rados/multimon/{clusters/21 msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185882/ [5185884] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{rhel_8}} time: 00:16:06 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185884/ [5185885] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:30:01 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185885/ [5185886] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:21:46 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185886/ [5185887] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{ubuntu_latest} fixed-2} time: 00:17:33 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185887/ [5185888] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} time: 01:20:10 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185888/ [5185889] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185889/ [5185890] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/failover} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185890/ [5185891] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:09 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185891/ [5185892] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:28:12 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185892/ [5185893] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:36:34 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185893/ [5185894] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:50:45 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185894/ [5185895] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:21:05 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185895/ [5185896] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185896/ [5185897] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_api_tests} time: 00:29:27 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185897/ [5185898] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} time: 01:00:26 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185898/ [5185899] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185899/ [5185900] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:22:45 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185900/ [5185901] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185901/ [5185902] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:17:54 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185902/ [5185903] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{rhel_8}} time: 00:13:05 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185903/ [5185904] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185904/ [5185905] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185905/ [5185906] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185906/ [5185908] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:20:56 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185908/ [5185909] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:42:25 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185909/ [5185910] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185910/ [5185911] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:55 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185911/ [5185912] rados/singleton/{all/admin-socket msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185912/ [5185913] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185913/ [5185914] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185914/ [5185915] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:06:48 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185915/ [5185916] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185916/ [5185917] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:38:14 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185917/ [5185918] rados/singleton/{all/deduptool msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185918/ [5185919] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{ubuntu_latest}} time: 00:10:31 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185919/ [5185920] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:24:22 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185920/ [5185921] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:16 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185921/ [5185922] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185922/ [5185923] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:15:08 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185923/ [5185925] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185925/ [5185926] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:22:22 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185926/ [5185927] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185927/ [5185928] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:58 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185928/ [5185929] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:51:47 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185929/ [5185930] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:04 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185930/ [5185931] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:32 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185931/ [5185932] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:27:56 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185932/ [5185933] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:39:36 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185933/ [5185934] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185934/ [5185935] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185935/ [5185936] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185936/ [5185937] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:16:24 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185937/ [5185938] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185938/ [5185939] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{centos_8}} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185939/ [5185940] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_python} time: 00:27:27 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185940/ [5185941] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:13 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185941/ [5185942] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:35 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185942/ [5185943] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:32 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185943/ [5185944] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:07:48 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185944/ [5185945] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185945/ [5185946] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/set-chunk-promote-flush} time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185946/ [5185947] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185947/ [5185949] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185949/ [5185950] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185950/ [5185951] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:26:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185951/ [5185952] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:38:37 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185952/ [5185953] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185953/ [5185954] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185954/ [5185955] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:28:22 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185955/ [5185956] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{ubuntu_latest}} time: 00:07:11 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185956/ [5185957] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:18:03 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185957/ [5185958] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:34:35 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185958/ [5185960] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_workunits} time: 00:29:57 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185960/ [5185961] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:18 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185961/ [5185962] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:21:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185962/ [5185963] rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185963/ [5185964] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:28 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185964/ [5185965] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185965/ [5185966] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:02:55 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185966/ [5185967] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:40:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185967/ [5185968] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:18:53 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185968/ [5185969] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185969/ [5185970] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185970/ [5185971] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:11 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185971/ [5185972] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185972/ [5185973] rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:25:46 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185973/ [5185974] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185974/ [5185975] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{ubuntu_latest}} time: 00:07:33 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185975/ [5185976] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:27:00 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185976/ [5185977] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:26:59 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185977/ [5185978] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:24:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185978/ [5185979] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:18 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185979/ [5185980] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185980/ [5185981] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:34:45 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185981/ [5185982] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/progress} time: 00:18:10 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185982/ [5185983] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185983/ [5185984] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185984/ [5185985] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185985/ [5185986] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:06:51 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185986/ [5185987] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} time: 00:20:57 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185987/ [5185988] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:28:13 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185988/ [5185989] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:13 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185989/ [5185992] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{rhel_8}} time: 00:16:58 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185992/ [5185993] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:22:47 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185993/ [5185994] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:06:43 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185994/ [5185995] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185995/ [5185996] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:27:33 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185996/ [5185997] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185997/ [5185998] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:33:23 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185998/ [5185999] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:39:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5185999/ [5186000] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:39:19 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186000/ [5186001] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:51 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186001/ [5186002] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:24:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186002/ [5186004] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:40:45 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186004/ [5186005] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:34:39 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186005/ [5186006] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186006/ [5186007] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:16:43 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186007/ [5186008] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:15 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186008/ [5186009] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186009/ [5186010] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/prometheus} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186010/ [5186011] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{rhel_8}} time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186011/ [5186012] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:23:50 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186012/ [5186013] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186013/ [5186014] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186014/ [5186015] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186015/ [5186016] rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186016/ [5186017] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_python} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186017/ [5186018] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:32:44 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186018/ [5186019] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/many workloads/pool-create-delete} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186019/ [5186020] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:55 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186020/ [5186021] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:17:46 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186021/ [5186022] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186022/ [5186023] rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186023/ [5186025] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186025/ [5186026] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:15:17 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186026/ [5186027] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{ubuntu_latest}} time: 00:08:14 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186027/ [5186028] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186028/ [5186029] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:54 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186029/ [5186030] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:05 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186030/ [5186031] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:36 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186031/ [5186032] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:15:23 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186032/ [5186033] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186033/ [5186034] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:34:55 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186034/ [5186035] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186035/ [5186036] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:02:51 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186036/ [5186037] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186037/ [5186038] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{rhel_latest} fixed-2} time: 00:17:25 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186038/ [5186039] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186039/ [5186040] rados/singleton/{all/mon-config msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186040/ [5186041] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:47:24 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186041/ [5186042] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186042/ [5186043] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:45 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186043/ [5186044] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186044/ [5186045] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186045/ [5186046] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_8}} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186046/ [5186047] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:39:05 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186047/ [5186048] rados/singleton/{all/osd-backfill msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:15:28 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186048/ [5186049] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:23 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186049/ [5186050] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:41:31 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186050/ [5186051] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_5925} time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186051/ [5186052] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:20:48 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186052/ [5186053] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186053/ [5186054] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186054/ [5186055] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} time: 01:10:26 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186055/ [5186056] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:10:28 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186056/ [5186057] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:18:22 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186057/ [5186058] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186058/ [5186059] rados/multimon/{clusters/6 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:28 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186059/ [5186060] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:31 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186060/ [5186061] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:49 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186061/ [5186062] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186062/ [5186063] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186063/ [5186064] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{centos_8}} time: 00:12:55 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186064/ [5186065] rados/singleton/{all/osd-recovery msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186065/ [5186066] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:28:36 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186066/ [5186067] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/crash} time: 00:09:32 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186067/ [5186068] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:34:48 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186068/ [5186069] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 01:01:00 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186069/ [5186070] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:16:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186070/ [5186071] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186071/ [5186072] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186072/ [5186073] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:22:04 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186073/ [5186074] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:19:31 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186074/ [5186075] rados/singleton/{all/peer msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186075/ [5186076] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186076/ [5186077] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186077/ [5186078] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:26:49 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186078/ [5186079] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:14:07 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186079/ [5186080] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186080/ [5186081] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186081/ [5186082] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:22:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186082/ [5186083] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_8}} time: 00:22:05 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186083/ [5186084] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} time: 00:24:41 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186084/ [5186085] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:25:20 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186085/ [5186086] rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:17:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186086/ [5186088] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186088/ [5186089] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:23:54 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186089/ [5186090] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:34:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186090/ [5186091] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:17:33 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186091/ [5186092] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186092/ [5186093] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186093/ [5186094] rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:06:47 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186094/ [5186095] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186095/ [5186097] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186097/ [5186098] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186098/ [5186099] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{centos_8}} time: 00:16:56 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186099/ [5186100] rados/singleton/{all/radostool msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:21:10 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186100/ [5186101] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186101/ [5186102] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:33:33 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186102/ [5186103] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:25:31 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186103/ [5186104] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:01:03 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186104/ [5186105] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:30:53 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186105/ [5186106] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:29:04 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186106/ [5186107] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:11:58 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186107/ [5186108] rados/singleton/{all/random-eio msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186108/ [5186110] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186110/ [5186111] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:46 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186111/ [5186112] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 03:00:46 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186112/ [5186113] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:54:58 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186113/ [5186114] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache} time: 00:16:33 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186114/ [5186115] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186115/ [5186116] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{ubuntu_latest}} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186116/ [5186117] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186117/ [5186118] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:24:59 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186118/ [5186119] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186119/ [5186121] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186121/ [5186123] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:27 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186123/ [5186124] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup_tier} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186124/ [5186125] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:15:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186125/ [5186126] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:11:32 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186126/ [5186128] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186128/ [5186129] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:22:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186129/ [5186130] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 01:25:11 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186130/ [5186131] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:33:01 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186131/ [5186132] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-radosbench} time: 01:24:00 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186132/ [5186133] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186133/ [5186134] rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:44 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186134/ [5186135] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_8}} time: 00:32:29 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186135/ [5186136] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/pool-snaps-few-objects} time: 00:25:56 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186136/ [5186137] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:35:04 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186137/ [5186138] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:00:27 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186138/ [5186139] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 04:36:11 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186139/ [5186140] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186140/ [5186141] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186141/ [5186142] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186142/ [5186143] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186143/ [5186144] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:30:21 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186144/ [5186145] rados/singleton/{all/test-crash msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186145/ [5186146] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186146/ [5186147] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/rados_api_tests} time: 00:30:09 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186147/ [5186148] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:13 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186148/ [5186149] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:23:09 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186149/ [5186150] rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186150/ [5186151] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:39 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186151/ [5186152] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:21:31 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186152/ [5186155] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_8}} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186155/ [5186156] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186156/ [5186157] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:30:59 info: http://pulpito.ceph.com/teuthology-2020-06-28_07:01:02-rados-master-distro-basic-smithi/5186157/