2021-01-10T08:59:43.863 INFO:root:teuthology version: 1.0.0-77817aa4 2021-01-10T08:59:43.865 INFO:teuthology.results:subset: '14/100000' 2021-01-10T08:59:43.865 INFO:teuthology.results:seed: '717' 2021-01-10T13:19:52.072 INFO:root:teuthology version: 1.0.0-77817aa4 2021-01-10T13:19:52.126 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-11T01:06:26.777 INFO:teuthology.results:Tests finished! gathering results... 2021-01-11T01:07:57.649 INFO:scrape:Found 367 jobs 2021-01-11T01:08:07.612 INFO:scrape:Found 10 distinct failure reasons 2021-01-11T01:08:07.613 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2021-01-11T01:08:07.614 INFO:scrape:2 jobs: ['5772645', '5772509'] 2021-01-11T01:08:07.614 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2021-01-11T01:08:07.614 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2021-01-11T01:08:07.615 INFO:scrape: 2021-01-11T01:08:07.615 INFO:scrape:Dead: b'2021-01-10T23:24:00.469 DEBUG:teuthology.exit:Finished running handlers' 2021-01-11T01:08:07.616 INFO:scrape:6 jobs: ['5772639', '5772624', '5772731', '5772694', '5772434', '5772615'] 2021-01-11T01:08:07.616 INFO:scrape:suites intersection: [] 2021-01-11T01:08:07.617 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/objectstore/{backends/objectstore', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashosds-health', 'workloads/rados_api_tests}', 'workloads/radosbench-high-concurrency}', 'workloads/radosbench}', 'workloads/small-objects-balanced}'] 2021-01-11T01:08:07.617 INFO:scrape: 2021-01-11T01:08:07.618 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi098 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh' 2021-01-11T01:08:07.618 INFO:scrape:2 jobs: ['5772564', '5772746'] 2021-01-11T01:08:07.618 INFO:scrape:suites intersection: ['workloads/scrub}'] 2021-01-11T01:08:07.619 INFO:scrape:suites union: ['rados/standalone/{mon_election/classic', 'rados/standalone/{mon_election/connectivity', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/scrub}'] 2021-01-11T01:08:07.619 INFO:scrape: 2021-01-11T01:08:07.620 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0' 2021-01-11T01:08:07.620 INFO:scrape:1 jobs: ['5772417'] 2021-01-11T01:08:07.621 INFO:scrape:suites: ['cluster/{12-osds', 'mon_election/classic', 'msgr-failures/osd-delay', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash-erasure-code-big/{ceph', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}'] 2021-01-11T01:08:07.621 INFO:scrape: 2021-01-11T01:08:07.621 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2021-01-11T01:08:07.622 INFO:scrape:1 jobs: ['5772516'] 2021-01-11T01:08:07.622 INFO:scrape:suites: ['2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{centos_latest}', 'fixed-2', 'mon_election/classic}', 'rados/cephadm/upgrade/{1-start'] 2021-01-11T01:08:07.623 INFO:scrape: 2021-01-11T01:08:07.623 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json 2021-01-11T01:08:07.623 INFO:scrape:1 jobs: ['5772631'] 2021-01-11T01:08:07.624 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async', 'no_pools', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/multimon/{clusters/9', 'supported-random-distro$/{centos_8}', 'tasks/mon_recovery}'] 2021-01-11T01:08:07.624 INFO:scrape: 2021-01-11T01:08:07.625 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi035 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-01-11T01:08:07.625 INFO:scrape:3 jobs: ['5772418', '5772423', '5772665'] 2021-01-11T01:08:07.626 INFO:scrape:suites intersection: ['rados'] 2021-01-11T01:08:07.626 INFO:scrape:suites union: ['ceph', 'clusters/9-mons', 'clusters/{fixed-2', 'd-thrash/default/{default', 'd-thrash/none', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/mon-delay', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/monthrash/{ceph', 'rados/verify/{centos_latest', 'supported-random-distro$/{centos_8}', 'tasks/rados_api_tests', 'thrashers/many', 'thrashosds-health}', 'validater/lockdep}', 'validater/valgrind}', 'workloads/rados_api_tests}'] 2021-01-11T01:08:07.626 INFO:scrape: 2021-01-11T01:08:07.627 INFO:scrape:Failure: Command failed on smithi069 with status 1: 'sudo docker kill -s 1 ceph-f02f7296-5346-11eb-8f8e-001a4aab830c-osd.7' 2021-01-11T01:08:07.627 INFO:scrape:1 jobs: ['5772747'] 2021-01-11T01:08:07.628 INFO:scrape:suites: ['1-install/luminous', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2021-01-11T01:08:07.628 INFO:scrape: 2021-01-11T01:08:07.629 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi190 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-01-11T01:08:07.629 INFO:scrape:1 jobs: ['5772400'] 2021-01-11T01:08:07.629 INFO:scrape:suites: ['mon_election/classic', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2021-01-11T01:08:07.630 INFO:scrape: 2021-01-11T01:08:07.630 INFO:scrape:Failure: Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi080 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh' 2021-01-11T01:08:07.631 INFO:scrape:1 jobs: ['5772459'] 2021-01-11T01:08:07.631 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}', 'thrashers/one', 'workloads/rados_mon_osdmap_prune}'] 2021-01-11T01:08:07.631 INFO:scrape: 2021-01-11T01:08:07.644 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/ failed: 13 dead: 6 running: 0 waiting: 0 queued: 0 passed: 348 Fail ================================================================= [5772400] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772400/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772400/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0edca1a2a77341aa87a4106e0769b098 Command failed (workunit test cephadm/test_cephadm.sh) on smithi190 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5772417] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 10:43:42 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772417/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772417/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride- size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0' [5772418] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:34:18 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772418/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772418/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41782a48790f4ad8b36c8e3b4958f7ed Command failed (workunit test rados/test.sh) on smithi035 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5772423] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:43:42 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772423/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772423/ sentry: https://sentry.ceph.com/organizations/ceph/?query=55710e191fb0447ca55994b4836f775d Command failed (workunit test rados/test.sh) on smithi184 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5772459] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:58:02 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772459/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772459/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e11698341b894b61b9b22910f43cde66 Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi080 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh' [5772509] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:16:57 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772509/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772509/ sentry: https://sentry.ceph.com/organizations/ceph/?query=190a230543ba41cf9524ee475b846cdf Command failed (workunit test cephadm/test_adoption.sh) on smithi142 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5772516] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:17:30 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772516/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772516/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3519d08b25c345b3ad3b4b89d9b12bb4 reached maximum tries (180) after waiting for 180 seconds [5772564] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/scrub} ----------------------------------------------------------------- time: 01:21:57 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772564/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772564/ sentry: https://sentry.ceph.com/organizations/ceph/?query=de5e3146b8724820b4c01707068ff6a4 Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi098 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub- snaps.sh' [5772631] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} ----------------------------------------------------------------- time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772631/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772631/ sentry: https://sentry.ceph.com/organizations/ceph/?query=23030cf98b0c42a3906f3ac8b7fb9bb2 Command failed on smithi133 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [5772645] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:16:40 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772645/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772645/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d39266475ca040b79f4185b944ad36e8 Command failed (workunit test cephadm/test_adoption.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5772665] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:47:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772665/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772665/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5eccfcd9dda743d09f3a960afffd8297 Command failed (workunit test rados/test.sh) on smithi153 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5772746] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/scrub} ----------------------------------------------------------------- time: 01:22:01 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772746/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772746/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1a15884942ed48b1951d0419e2f3bcd3 Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi013 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d3fa8889ff1fe4f1466e27552a5b0f550f2c4900 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub- snaps.sh' [5772747] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:36:47 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772747/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772747/ Command failed on smithi069 with status 1: 'sudo docker kill -s 1 ceph-f02f7296-5346-11eb-8f8e-001a4aab830c-osd.7' Dead ================================================================= [5772434] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772434/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772434/ [5772615] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772615/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772615/ [5772624] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772624/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772624/ [5772639] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772639/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772639/ [5772694] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772694/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772694/ [5772731] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772731/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772731/ Pass ================================================================= [5772388] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:14 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772388/ [5772389] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772389/ [5772390] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:20:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772390/ [5772391] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:21:48 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772391/ [5772392] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772392/ [5772393] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:20:54 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772393/ [5772394] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:42:29 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772394/ [5772395] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772395/ [5772396] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772396/ [5772397] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772397/ [5772398] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:28:58 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772398/ [5772399] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:25:09 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772399/ [5772401] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:17:52 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772401/ [5772402] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:09:09 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772402/ [5772403] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:50:22 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772403/ [5772404] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772404/ [5772405] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772405/ [5772406] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:17:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772406/ [5772407] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772407/ [5772408] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:18:23 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772408/ [5772409] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:35:35 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772409/ [5772410] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:08 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772410/ [5772411] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/radosbench} time: 01:03:18 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772411/ [5772412] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772412/ [5772413] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:34:41 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772413/ [5772414] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772414/ [5772415] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:40 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772415/ [5772416] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:44 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772416/ [5772419] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:27 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772419/ [5772420] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772420/ [5772421] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772421/ [5772422] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:46 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772422/ [5772424] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:17:33 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772424/ [5772425] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:19:58 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772425/ [5772426] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:13:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772426/ [5772427] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772427/ [5772428] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772428/ [5772429] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:06 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772429/ [5772430] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772430/ [5772431] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:30:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772431/ [5772432] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:07:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772432/ [5772433] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:46:03 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772433/ [5772435] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772435/ [5772436] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:17:25 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772436/ [5772437] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:20:49 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772437/ [5772438] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:08 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772438/ [5772439] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772439/ [5772440] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772440/ [5772441] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/failover} time: 00:13:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772441/ [5772442] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772442/ [5772443] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772443/ [5772444] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772444/ [5772445] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772445/ [5772446] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:33 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772446/ [5772447] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772447/ [5772448] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:59 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772448/ [5772449] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772449/ [5772450] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_cls_all validater/valgrind} time: 02:22:42 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772450/ [5772451] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772451/ [5772452] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772452/ [5772453] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:25:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772453/ [5772454] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772454/ [5772455] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772455/ [5772456] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:37:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772456/ [5772457] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:09:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772457/ [5772458] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:20:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772458/ [5772460] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:41:49 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772460/ [5772461] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mgr} time: 00:19:55 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772461/ [5772462] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772462/ [5772463] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772463/ [5772464] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:36:50 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772464/ [5772465] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:19:44 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772465/ [5772466] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772466/ [5772467] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772467/ [5772468] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:19 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772468/ [5772469] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:37 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772469/ [5772470] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772470/ [5772471] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772471/ [5772472] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772472/ [5772473] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772473/ [5772474] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772474/ [5772475] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/insights} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772475/ [5772476] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772476/ [5772477] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:52 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772477/ [5772478] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} time: 00:17:37 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772478/ [5772479] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772479/ [5772480] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:30:01 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772480/ [5772481] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772481/ [5772482] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/misc} time: 00:37:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772482/ [5772483] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:05 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772483/ [5772484] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/lockdep} time: 00:26:53 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772484/ [5772485] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772485/ [5772486] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772486/ [5772487] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:13:29 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772487/ [5772488] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:22 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772488/ [5772489] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:08:48 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772489/ [5772490] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:27 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772490/ [5772491] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:28:55 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772491/ [5772492] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772492/ [5772493] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:34:47 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772493/ [5772494] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:58 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772494/ [5772495] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:30:34 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772495/ [5772496] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:39:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772496/ [5772497] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:23:14 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772497/ [5772498] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772498/ [5772499] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772499/ [5772500] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:48:42 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772500/ [5772501] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772501/ [5772502] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772502/ [5772503] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772503/ [5772504] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:41:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772504/ [5772505] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772505/ [5772506] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:35:36 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772506/ [5772507] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:21:10 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772507/ [5772508] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:36 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772508/ [5772510] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:19 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772510/ [5772511] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mon} time: 00:47:52 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772511/ [5772512] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:40:33 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772512/ [5772513] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772513/ [5772514] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772514/ [5772515] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:15:37 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772515/ [5772517] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772517/ [5772518] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772518/ [5772519] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772519/ [5772520] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} time: 00:28:16 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772520/ [5772521] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772521/ [5772522] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:32:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772522/ [5772523] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:21:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772523/ [5772524] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:42:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772524/ [5772525] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:37 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772525/ [5772526] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:35 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772526/ [5772527] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:23:01 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772527/ [5772528] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772528/ [5772529] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:51 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772529/ [5772530] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:06:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772530/ [5772531] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:19:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772531/ [5772532] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772532/ [5772533] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_workunits} time: 00:37:25 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772533/ [5772534] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:32:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772534/ [5772535] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:16:54 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772535/ [5772536] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:41 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772536/ [5772537] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772537/ [5772538] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:21:59 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772538/ [5772539] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:14:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772539/ [5772540] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/osd} time: 03:13:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772540/ [5772541] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} time: 00:22:38 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772541/ [5772542] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772542/ [5772543] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:26:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772543/ [5772544] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772544/ [5772545] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:19:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772545/ [5772546] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/progress} time: 00:18:10 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772546/ [5772547] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:31:23 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772547/ [5772548] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:10 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772548/ [5772549] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772549/ [5772550] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:06 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772550/ [5772551] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:37:55 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772551/ [5772552] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772552/ [5772553] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/connectivity} time: 00:18:28 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772553/ [5772554] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:22:40 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772554/ [5772555] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:20 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772555/ [5772556] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:36:25 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772556/ [5772557] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:44 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772557/ [5772558] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} time: 00:32:51 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772558/ [5772559] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:42:09 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772559/ [5772560] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772560/ [5772561] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:29:42 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772561/ [5772562] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:29 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772562/ [5772563] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772563/ [5772565] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772565/ [5772566] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 01:26:41 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772566/ [5772567] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:27:50 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772567/ [5772568] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:20:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772568/ [5772569] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:29:21 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772569/ [5772570] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:22:35 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772570/ [5772571] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:35 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772571/ [5772572] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:24:32 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772572/ [5772573] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772573/ [5772574] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:28 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772574/ [5772575] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772575/ [5772576] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:30:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772576/ [5772577] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} time: 00:13:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772577/ [5772578] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772578/ [5772579] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772579/ [5772580] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:26:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772580/ [5772581] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:29:46 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772581/ [5772582] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772582/ [5772583] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772583/ [5772584] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:26:26 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772584/ [5772585] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772585/ [5772586] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:45:55 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772586/ [5772587] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:30:55 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772587/ [5772588] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772588/ [5772589] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:13:06 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772589/ [5772590] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:17:23 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772590/ [5772591] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:37:21 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772591/ [5772592] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772592/ [5772593] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:34:21 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772593/ [5772594] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772594/ [5772595] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} time: 02:21:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772595/ [5772596] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772596/ [5772597] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:08:44 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772597/ [5772598] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:26:59 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772598/ [5772599] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:29:10 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772599/ [5772600] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:57 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772600/ [5772601] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772601/ [5772602] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772602/ [5772603] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772603/ [5772604] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/many workloads/pool-create-delete} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772604/ [5772605] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772605/ [5772606] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:34:08 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772606/ [5772607] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772607/ [5772608] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:09:04 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772608/ [5772609] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772609/ [5772610] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:23 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772610/ [5772611] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:16:38 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772611/ [5772612] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:04 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772612/ [5772613] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772613/ [5772614] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:41:30 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772614/ [5772616] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/workunits} time: 00:17:51 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772616/ [5772617] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772617/ [5772618] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} time: 01:29:24 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772618/ [5772619] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:45:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772619/ [5772620] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:06:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772620/ [5772621] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} time: 00:19:12 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772621/ [5772622] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:21 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772622/ [5772623] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:12:56 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772623/ [5772625] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:17:41 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772625/ [5772626] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772626/ [5772627] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:08:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772627/ [5772628] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772628/ [5772629] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:29 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772629/ [5772630] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772630/ [5772632] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-radosbench} time: 03:06:09 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772632/ [5772633] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772633/ [5772634] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772634/ [5772635] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772635/ [5772636] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:23:55 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772636/ [5772637] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:16 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772637/ [5772638] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772638/ [5772640] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:29:50 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772640/ [5772641] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_5925} time: 00:07:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772641/ [5772642] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mgr} time: 00:19:55 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772642/ [5772643] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772643/ [5772644] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772644/ [5772646] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:35:36 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772646/ [5772647] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772647/ [5772648] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:04 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772648/ [5772649] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772649/ [5772650] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772650/ [5772651] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/crash} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772651/ [5772652] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:23 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772652/ [5772653] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772653/ [5772654] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772654/ [5772655] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:38:24 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772655/ [5772656] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772656/ [5772657] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772657/ [5772658] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772658/ [5772659] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772659/ [5772660] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772660/ [5772661] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772661/ [5772662] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:40:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772662/ [5772663] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:15 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772663/ [5772664] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772664/ [5772666] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:31:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772666/ [5772667] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/misc} time: 00:35:40 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772667/ [5772668] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772668/ [5772669] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:28 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772669/ [5772670] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:20 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772670/ [5772671] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:35 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772671/ [5772672] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:59 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772672/ [5772673] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772673/ [5772674] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772674/ [5772675] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772675/ [5772676] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} time: 00:36:36 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772676/ [5772677] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:20 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772677/ [5772678] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772678/ [5772679] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:25:44 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772679/ [5772680] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772680/ [5772681] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:25:54 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772681/ [5772682] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772682/ [5772683] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:48:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772683/ [5772684] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772684/ [5772685] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} time: 00:22:56 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772685/ [5772686] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/failover} time: 00:13:52 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772686/ [5772687] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:33 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772687/ [5772688] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:32:19 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772688/ [5772689] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:54:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772689/ [5772690] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:31:38 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772690/ [5772691] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:22 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772691/ [5772692] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:36:18 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772692/ [5772693] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:47:40 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772693/ [5772695] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772695/ [5772696] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772696/ [5772697] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:47:45 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772697/ [5772698] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic} time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772698/ [5772699] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:26:55 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772699/ [5772700] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772700/ [5772701] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772701/ [5772702] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:45 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772702/ [5772703] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:26:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772703/ [5772704] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:37 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772704/ [5772705] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772705/ [5772706] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:04:40 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772706/ [5772707] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772707/ [5772708] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:22:02 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772708/ [5772709] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772709/ [5772710] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:23:30 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772710/ [5772711] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772711/ [5772712] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:04:58 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772712/ [5772713] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:40:59 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772713/ [5772714] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:54 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772714/ [5772715] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:53:46 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772715/ [5772716] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:35:47 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772716/ [5772717] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772717/ [5772718] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772718/ [5772719] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772719/ [5772720] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:23:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772720/ [5772721] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:10:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772721/ [5772722] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/osd} time: 03:11:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772722/ [5772723] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:14:49 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772723/ [5772724] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772724/ [5772725] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:18:50 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772725/ [5772726] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:42 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772726/ [5772727] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772727/ [5772728] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772728/ [5772729] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772729/ [5772730] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:25 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772730/ [5772732] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772732/ [5772733] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:28:00 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772733/ [5772734] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:24:34 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772734/ [5772735] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:18:11 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772735/ [5772736] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:23 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772736/ [5772737] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772737/ [5772738] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:32:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772738/ [5772739] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/connectivity} time: 00:16:31 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772739/ [5772740] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:29:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772740/ [5772741] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772741/ [5772742] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772742/ [5772743] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772743/ [5772744] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:24:17 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772744/ [5772745] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772745/ [5772748] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:19:02 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772748/ [5772749] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:36:43 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772749/ [5772750] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:19:07 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772750/ [5772751] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772751/ [5772752] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:29:31 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772752/ [5772753] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:28:57 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772753/ [5772754] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:13 info: http://pulpito.ceph.com/teuthology-2021-01-10_07:01:02-rados-master-distro-basic-smithi/5772754/