2021-01-06T09:03:08.678 INFO:root:teuthology version: 1.0.0-8e49dda4 2021-01-06T09:03:08.680 INFO:teuthology.results:subset: '10/100000' 2021-01-06T09:03:08.680 INFO:teuthology.results:seed: '6719' 2021-01-06T13:15:42.372 INFO:root:teuthology version: 1.0.0-8e49dda4 2021-01-06T13:15:42.424 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-07T01:03:07.306 INFO:teuthology.results:Tests finished! gathering results... 2021-01-07T01:07:09.093 INFO:scrape:Found 367 jobs 2021-01-07T01:07:41.014 INFO:scrape:Found 10 distinct failure reasons 2021-01-07T01:07:41.015 INFO:scrape:Failure: Command failed on smithi170 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' 2021-01-07T01:07:41.015 INFO:scrape:45 jobs 2021-01-07T01:07:41.016 INFO:scrape:suites intersection: [] 2021-01-07T01:07:41.016 INFO:scrape:suites union: ['2-repo_digest/defaut', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_18.04_podman}', 'distro$/{ubuntu_latest}', 'fixed-2', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr-failures/many', 'msgr/async', 'no_pools', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/cephadm/smoke-roleless/{distro/centos_8.0', 'rados/cephadm/smoke-roleless/{distro/centos_latest', 'rados/cephadm/smoke-roleless/{distro/rhel_8.0', 'rados/cephadm/smoke-roleless/{distro/rhel_latest', 'rados/cephadm/smoke-roleless/{distro/ubuntu_18.04', 'rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman', 'rados/cephadm/smoke-roleless/{distro/ubuntu_latest', 'rados/cephadm/smoke/{distro/centos_8.0', 'rados/cephadm/smoke/{distro/centos_latest', 'rados/cephadm/smoke/{distro/rhel_8.0', 'rados/cephadm/smoke/{distro/rhel_latest', 'rados/cephadm/smoke/{distro/ubuntu_18.04', 'rados/cephadm/smoke/{distro/ubuntu_18.04_podman', 'rados/cephadm/smoke/{distro/ubuntu_latest', 'rados/cephadm/upgrade/{1-start', 'rados/multimon/{clusters/3', 'start}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/mon_clock_no_skews}'] 2021-01-07T01:07:41.017 INFO:scrape: 2021-01-07T01:07:41.017 INFO:scrape:Failure: Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi140 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-snaps.sh' 2021-01-07T01:07:41.018 INFO:scrape:2 jobs: ['5759626', '5759443'] 2021-01-07T01:07:41.018 INFO:scrape:suites intersection: ['supported-random-distro$/{centos_8}', 'workloads/scrub}'] 2021-01-07T01:07:41.019 INFO:scrape:suites union: ['rados/standalone/{mon_election/classic', 'rados/standalone/{mon_election/connectivity', 'supported-random-distro$/{centos_8}', 'workloads/scrub}'] 2021-01-07T01:07:41.019 INFO:scrape: 2021-01-07T01:07:41.019 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2021-01-07T01:07:41.020 INFO:scrape:2 jobs: ['5759423', '5759569'] 2021-01-07T01:07:41.020 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-01-07T01:07:41.021 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-01-07T01:07:41.022 INFO:scrape: 2021-01-07T01:07:41.022 INFO:scrape:Failure: Command failed (workunit test cephtool/test.sh) on smithi092 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' 2021-01-07T01:07:41.023 INFO:scrape:1 jobs: ['5759285'] 2021-01-07T01:07:41.023 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{rhel_8}}'] 2021-01-07T01:07:41.024 INFO:scrape: 2021-01-07T01:07:41.024 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi136 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-01-07T01:07:41.024 INFO:scrape:1 jobs: ['5759394'] 2021-01-07T01:07:41.025 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/default', 'thrashosds-health', 'workloads/rados_api_tests}'] 2021-01-07T01:07:41.025 INFO:scrape: 2021-01-07T01:07:41.026 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi148 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2021-01-07T01:07:41.026 INFO:scrape:1 jobs: ['5759345'] 2021-01-07T01:07:41.027 INFO:scrape:suites: ['mon_election/connectivity', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2021-01-07T01:07:41.027 INFO:scrape: 2021-01-07T01:07:41.027 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2021-01-07T01:07:41.028 INFO:scrape:5 jobs: ['5759498', '5759397', '5759529', '5759349', '5759578'] 2021-01-07T01:07:41.028 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2021-01-07T01:07:41.029 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{centos_latest}', 'distro$/{rhel_8.0}', 'distro$/{rhel_latest}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2021-01-07T01:07:41.029 INFO:scrape: 2021-01-07T01:07:41.029 INFO:scrape:Dead: b'2021-01-07T01:00:20.310 DEBUG:teuthology.exit:Finished running handlers' 2021-01-07T01:07:41.030 INFO:scrape:6 jobs: ['5759616', '5759607', '5759471', '5759462', '5759402', '5759609'] 2021-01-07T01:07:41.030 INFO:scrape:suites intersection: [] 2021-01-07T01:07:41.031 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/objectstore/{backends/objectstore', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'recovery-overrides/{default}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/cache-snaps-balanced}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/radosbench-high-concurrency}', 'workloads/small-objects-balanced}'] 2021-01-07T01:07:41.031 INFO:scrape: 2021-01-07T01:07:41.032 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-01-07T01:07:41.032 INFO:scrape:1 jobs: ['5759519'] 2021-01-07T01:07:41.033 INFO:scrape:suites: ['mon_election/connectivity', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2021-01-07T01:07:41.033 INFO:scrape: 2021-01-07T01:07:41.033 INFO:scrape:Failure: "2021-01-06T12:08:56.045819+0000 mon.b (mon.0) 21 : cluster [WRN] Health check failed: 1/9 mons down, quorum b,c,a,e,f,d,h,g (MON_DOWN)" in cluster log 2021-01-07T01:07:41.034 INFO:scrape:1 jobs: ['5759520'] 2021-01-07T01:07:41.034 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async', 'no_pools', 'objectstore/filestore-xfs', 'rados', 'rados/multimon/{clusters/9', 'supported-random-distro$/{rhel_8}', 'tasks/mon_clock_no_skews}'] 2021-01-07T01:07:41.035 INFO:scrape: 2021-01-07T01:07:41.049 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/ failed: 59 dead: 6 running: 0 waiting: 0 queued: 0 passed: 302 Fail ================================================================= [5759282] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759282/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759282/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f23a6776799446dab0c2d269ce072d5f Command failed on smithi012 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759285] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:33:12 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759285/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759285/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a11627930208492e8a7f42132c7fa8a2 Command failed (workunit test cephtool/test.sh) on smithi092 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' [5759301] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759301/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759301/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd1c043c55d64679b96cae49812c968a Command failed on smithi037 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759303] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} ----------------------------------------------------------------- time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759303/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759303/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fdf8713189164bff8b5ed6690f27f97c Command failed on smithi107 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759304] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:06:52 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759304/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759304/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a82ca8b439154157af79c0f7d6980754 Command failed on smithi155 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' [5759307] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:10:06 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759307/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759307/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8d4163302a243789fea113f353a879c Command failed on smithi172 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759321] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:11:27 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759321/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759321/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f48dffa287e84cef871c52ad8c2acb57 Command failed on smithi162 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759332] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:13:32 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759332/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759332/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14608a222cf04e688700d4c8f963f49c Command failed on smithi107 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759334] rados/cephadm/smoke-roleless/{distro/centos_latest start} ----------------------------------------------------------------- time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759334/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759334/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e31f1b94a334a6fa5d562f1a2ec2659 Command failed on smithi124 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759342] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:10:52 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759342/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759342/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da02d3efe3f34b96b5072f0dd36ff5b0 Command failed on smithi180 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759345] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759345/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759345/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae65a119a17d45a4b3e82ecfbe0c6cff Command failed (workunit test cephadm/test_adoption.sh) on smithi148 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5759349] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759349/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759349/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8209bdc4c9f245179a2c8ba86225e778 reached maximum tries (180) after waiting for 180 seconds [5759357] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759357/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759357/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3fcd3cd2d5574e0e9ea1130442106379 Command failed on smithi170 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759361] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759361/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759361/ sentry: https://sentry.ceph.com/organizations/ceph/?query=08346733d25e453185e2dd1290f90190 Command failed on smithi073 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759367] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759367/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759367/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a9acbedf0da4439a5a49e8145ab11dd Command failed on smithi159 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759379] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759379/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759379/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c657c6741b9644bb84457c806048975a Command failed on smithi028 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759383] rados/cephadm/smoke-roleless/{distro/rhel_latest start} ----------------------------------------------------------------- time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759383/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759383/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd2a63ad2fac4e41a18c12fbe5d7b8e5 Command failed on smithi166 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759393] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:12:03 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759393/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759393/ sentry: https://sentry.ceph.com/organizations/ceph/?query=52d906648a1a43ad9da29e50320b7766 Command failed on smithi119 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759394] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:58:14 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759394/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759394/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1cb2dab0b3a644e4aa9deb48f9e4366a Command failed (workunit test rados/test.sh) on smithi136 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5759397] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759397/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759397/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7ee8227bbe98404584f31219dd7de932 reached maximum tries (180) after waiting for 180 seconds [5759403] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759403/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759403/ sentry: https://sentry.ceph.com/organizations/ceph/?query=afd983fcbd0d40f197e6a5352882bcb9 Command failed on smithi159 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759408] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} ----------------------------------------------------------------- time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759408/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759408/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b2b4552a78524869b97be8500037557c Command failed on smithi148 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759421] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759421/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759421/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2eb0d4829b8e473b803836f264d5877d Command failed on smithi007 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759423] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:47:02 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759423/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759423/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7a942b015bf547d39002b1fa60d6713e Command failed (workunit test rados/test.sh) on smithi120 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5759429] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759429/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759429/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b1f674160504c2ead04ac7a2bd42ab4 Command failed on smithi035 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759435] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759435/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759435/ sentry: https://sentry.ceph.com/organizations/ceph/?query=821ffabc9eb343a3ba19779548a5fe13 Command failed on smithi059 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759441] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759441/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759441/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01a1d484f08a4a90a9479431b6ae20bd Command failed on smithi103 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759442] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759442/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759442/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f2249f9901e41b68d9de309c3415b53 Command failed on smithi043 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759443] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/scrub} ----------------------------------------------------------------- time: 01:22:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759443/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759443/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0d2be5b40bb42e8bf2d897a4b17e778 Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi199 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub- snaps.sh' [5759457] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759457/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759457/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f540b4c64a7247298b827d7ecec6d84b Command failed on smithi008 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759464] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} ----------------------------------------------------------------- time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759464/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759464/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9e0a53567af145f89d87f5238930c55d Command failed on smithi183 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759466] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759466/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759466/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8639bb9bb3174b67ab8b4def4e13c079 Command failed on smithi191 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759487] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759487/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759487/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82afbc2d344b4a7ba2c1d9a1acd178c3 Command failed on smithi189 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759493] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} ----------------------------------------------------------------- time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759493/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759493/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77c3738a3b2e473f8480f3f0a68ecbfb Command failed on smithi114 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759498] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:16:52 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759498/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759498/ sentry: https://sentry.ceph.com/organizations/ceph/?query=707d15a8e94a45379b3ecdbaa6648ea9 reached maximum tries (180) after waiting for 180 seconds [5759505] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759505/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759505/ sentry: https://sentry.ceph.com/organizations/ceph/?query=996f4a32a2e04d8e9c282bb83ce36a33 Command failed on smithi105 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759511] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759511/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759511/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ddc82bd30484caa855650da88146377 Command failed on smithi143 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759514] rados/cephadm/smoke-roleless/{distro/centos_latest start} ----------------------------------------------------------------- time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759514/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759514/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59ca7ede584243ecacc58d1a4aac19f0 Command failed on smithi148 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759519] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759519/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759519/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99988736b88e4168977689c1faf9407c Command failed (workunit test cephadm/test_cephadm.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5759520] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759520/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759520/ "2021-01-06T12:08:56.045819+0000 mon.b (mon.0) 21 : cluster [WRN] Health check failed: 1/9 mons down, quorum b,c,a,e,f,d,h,g (MON_DOWN)" in cluster log [5759525] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:10:42 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759525/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759525/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d7199f374c374c24bc70c5c355bd85a7 Command failed on smithi114 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759529] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:19:30 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759529/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759529/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c26bc6cb90845afbb3ba8080a2b2b76 reached maximum tries (180) after waiting for 180 seconds [5759541] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759541/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759541/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91bc7c5967ff4a2196161ff6223bd9fb Command failed on smithi027 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759544] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:13:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759544/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759544/ sentry: https://sentry.ceph.com/organizations/ceph/?query=70a6ab43ba3b45acbeaa3d0fc339ae06 Command failed on smithi064 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759548] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759548/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759548/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b0da878178841428d5c6b2a1b22d06d Command failed on smithi183 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759564] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:08 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759564/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759564/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d53829eeb48c4c50bf6dabf6944b2a14 Command failed on smithi041 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759567] rados/cephadm/smoke-roleless/{distro/rhel_latest start} ----------------------------------------------------------------- time: 00:10:12 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759567/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759567/ sentry: https://sentry.ceph.com/organizations/ceph/?query=131867ab6c09424885d87a27dcc7fd44 Command failed on smithi160 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759569] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:47:33 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759569/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759569/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24318e0a594c47669c3585a4f1daa5a7 Command failed (workunit test rados/test.sh) on smithi122 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5759574] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759574/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759574/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8223cbcbbdae4b3aa48605df03464ad1 Command failed on smithi172 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759578] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:16:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759578/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759578/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d915872e4574edcafb2ce4e8bc266c7 reached maximum tries (180) after waiting for 180 seconds [5759587] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759587/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759587/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8521e1298a874c0fa3f3b410e3230dbd Command failed on smithi014 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759594] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} ----------------------------------------------------------------- time: 00:10:18 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759594/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759594/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a69acfbcb6f45eca0e5abbd4f7ae825 Command failed on smithi152 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759601] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:13:23 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759601/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759601/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6008cc0c9368415eb847d8512735cc61 Command failed on smithi198 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759610] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:13 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759610/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759610/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cbcf4e8d5b554e8c948525e8a7cbc1a5 Command failed on smithi001 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759613] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759613/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759613/ sentry: https://sentry.ceph.com/organizations/ceph/?query=255b09af90884e108b72ab18cd197bbe Command failed on smithi098 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759623] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759623/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759623/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f542bf2ae76f43d0b51d659c66f9953b Command failed on smithi105 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759624] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759624/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759624/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f0a0852c82a5435b9f39a61482339a06 Command failed on smithi094 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' [5759626] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/scrub} ----------------------------------------------------------------- time: 01:22:04 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759626/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759626/ sentry: https://sentry.ceph.com/organizations/ceph/?query=97847d835bf34c9699d55c8d03905c93 Command failed (workunit test scrub/osd-scrub-snaps.sh) on smithi140 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=485ddccc355360a985d4474e666ed8c2cec358f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub- snaps.sh' [5759638] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759638/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759638/ sentry: https://sentry.ceph.com/organizations/ceph/?query=de8aabaaddda4e05a0fce594610c5656 Command failed on smithi070 with status 127: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json' Dead ================================================================= [5759402] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759402/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759402/ [5759462] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759462/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759462/ [5759471] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759471/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759471/ [5759607] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759607/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759607/ [5759609] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759609/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759609/ [5759616] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759616/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759616/ Pass ================================================================= [5759272] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:28:26 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759272/ [5759273] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:05:34 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759273/ [5759274] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759274/ [5759275] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759275/ [5759276] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759276/ [5759277] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759277/ [5759278] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:28:13 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759278/ [5759279] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:26 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759279/ [5759280] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759280/ [5759281] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759281/ [5759283] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759283/ [5759284] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/crash} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759284/ [5759286] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:46 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759286/ [5759287] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:17:11 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759287/ [5759288] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:17:37 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759288/ [5759289] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759289/ [5759290] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/crush} time: 00:18:58 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759290/ [5759291] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759291/ [5759292] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:14:52 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759292/ [5759293] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759293/ [5759294] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:37:30 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759294/ [5759295] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:22:39 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759295/ [5759296] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:33:44 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759296/ [5759297] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759297/ [5759298] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759298/ [5759299] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759299/ [5759300] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:57 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759300/ [5759302] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:22:10 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759302/ [5759305] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:25:08 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759305/ [5759306] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:17:53 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759306/ [5759308] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759308/ [5759309] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:12:57 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759309/ [5759310] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:48 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759310/ [5759311] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:41:37 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759311/ [5759312] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759312/ [5759313] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:54 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759313/ [5759314] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:36:54 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759314/ [5759315] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:42:42 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759315/ [5759316] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} time: 00:18:43 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759316/ [5759317] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759317/ [5759318] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:35:07 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759318/ [5759319] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:15:57 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759319/ [5759320] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:26:33 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759320/ [5759322] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:07 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759322/ [5759323] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759323/ [5759324] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:20:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759324/ [5759325] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/failover} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759325/ [5759326] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:28:56 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759326/ [5759327] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:24:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759327/ [5759328] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:29:24 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759328/ [5759329] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:21:57 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759329/ [5759330] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:10 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759330/ [5759331] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759331/ [5759333] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:04 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759333/ [5759335] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:23:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759335/ [5759336] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759336/ [5759337] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:26:04 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759337/ [5759338] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759338/ [5759339] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759339/ [5759340] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:47 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759340/ [5759341] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mgr} time: 00:18:49 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759341/ [5759343] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759343/ [5759344] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_workunits} time: 00:35:36 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759344/ [5759346] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:27:11 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759346/ [5759347] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:24:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759347/ [5759348] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:20:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759348/ [5759350] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:31 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759350/ [5759351] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759351/ [5759352] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:22:54 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759352/ [5759353] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:14 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759353/ [5759354] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:44:25 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759354/ [5759355] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:06 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759355/ [5759356] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759356/ [5759358] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:19:14 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759358/ [5759359] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759359/ [5759360] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/insights} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759360/ [5759362] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:57 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759362/ [5759363] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:17:49 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759363/ [5759364] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:37:57 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759364/ [5759365] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/misc} time: 00:36:13 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759365/ [5759366] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759366/ [5759368] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759368/ [5759369] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:04 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759369/ [5759370] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759370/ [5759371] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:30:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759371/ [5759372] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759372/ [5759373] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:21:53 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759373/ [5759374] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:23:26 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759374/ [5759375] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759375/ [5759376] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:21:54 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759376/ [5759377] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:06:08 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759377/ [5759378] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:29:54 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759378/ [5759380] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:45:26 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759380/ [5759381] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} time: 00:34:48 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759381/ [5759382] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:27:45 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759382/ [5759384] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759384/ [5759385] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:16:18 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759385/ [5759386] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:28 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759386/ [5759387] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759387/ [5759388] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} time: 00:21:33 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759388/ [5759389] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:15:59 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759389/ [5759390] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:31 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759390/ [5759391] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:30 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759391/ [5759392] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759392/ [5759395] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:25:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759395/ [5759396] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mon} time: 00:49:47 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759396/ [5759398] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759398/ [5759399] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:16:03 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759399/ [5759400] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:37:15 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759400/ [5759401] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:40:26 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759401/ [5759404] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759404/ [5759405] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759405/ [5759406] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:06:11 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759406/ [5759407] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:21:03 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759407/ [5759409] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759409/ [5759410] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:38:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759410/ [5759411] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:19:22 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759411/ [5759412] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759412/ [5759413] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:40 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759413/ [5759414] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:34:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759414/ [5759415] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/radosbench} time: 02:21:59 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759415/ [5759416] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:20:52 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759416/ [5759417] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759417/ [5759418] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759418/ [5759419] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/pool-create-delete} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759419/ [5759420] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/osd} time: 03:12:38 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759420/ [5759422] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759422/ [5759424] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:53 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759424/ [5759425] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759425/ [5759426] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:29:13 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759426/ [5759427] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759427/ [5759428] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:19:53 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759428/ [5759430] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:31:31 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759430/ [5759431] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759431/ [5759432] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:27:12 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759432/ [5759433] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:52 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759433/ [5759434] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759434/ [5759436] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:30:55 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759436/ [5759437] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:15:23 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759437/ [5759438] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:06:40 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759438/ [5759439] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:15:27 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759439/ [5759440] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759440/ [5759444] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} time: 00:19:37 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759444/ [5759445] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759445/ [5759446] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:21:23 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759446/ [5759447] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:08:25 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759447/ [5759448] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:22 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759448/ [5759449] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:28:53 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759449/ [5759450] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:40:58 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759450/ [5759451] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:05:26 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759451/ [5759452] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:17:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759452/ [5759453] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759453/ [5759454] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 00:59:33 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759454/ [5759455] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_5925} time: 00:08:17 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759455/ [5759456] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759456/ [5759458] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:09:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759458/ [5759459] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759459/ [5759460] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759460/ [5759461] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:14:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759461/ [5759463] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:39 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759463/ [5759465] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/prometheus} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759465/ [5759467] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:39:12 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759467/ [5759468] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759468/ [5759469] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:21:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759469/ [5759470] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:47:12 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759470/ [5759472] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:14 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759472/ [5759473] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759473/ [5759474] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:16:46 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759474/ [5759475] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:46:45 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759475/ [5759476] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:28:56 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759476/ [5759477] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759477/ [5759478] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} time: 00:16:51 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759478/ [5759479] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:23:38 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759479/ [5759480] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:33:47 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759480/ [5759481] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:17:51 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759481/ [5759482] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:23:22 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759482/ [5759483] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:15 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759483/ [5759484] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759484/ [5759485] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759485/ [5759486] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759486/ [5759488] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 01:17:23 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759488/ [5759489] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_api_tests} time: 00:40:23 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759489/ [5759490] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:21 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759490/ [5759491] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759491/ [5759492] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759492/ [5759494] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759494/ [5759495] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759495/ [5759496] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759496/ [5759497] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:27:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759497/ [5759499] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:49 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759499/ [5759500] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/workunits} time: 00:17:27 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759500/ [5759501] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:46:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759501/ [5759502] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:27:28 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759502/ [5759503] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:54 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759503/ [5759504] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:28:07 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759504/ [5759506] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:37:53 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759506/ [5759507] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759507/ [5759508] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:43 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759508/ [5759509] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:42:40 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759509/ [5759510] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:27:55 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759510/ [5759512] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 01:09:59 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759512/ [5759513] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759513/ [5759515] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:30:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759515/ [5759516] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:20:00 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759516/ [5759517] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:24:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759517/ [5759518] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:13 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759518/ [5759521] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 01:34:06 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759521/ [5759522] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:16:40 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759522/ [5759523] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:55 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759523/ [5759524] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759524/ [5759526] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 01:13:35 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759526/ [5759527] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:28:37 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759527/ [5759528] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:40:21 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759528/ [5759530] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:09:29 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759530/ [5759531] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:51 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759531/ [5759532] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759532/ [5759533] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/crash} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759533/ [5759534] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:27 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759534/ [5759535] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759535/ [5759536] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:33 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759536/ [5759537] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:18:51 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759537/ [5759538] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:29:29 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759538/ [5759539] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:07 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759539/ [5759540] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:28 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759540/ [5759542] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:49 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759542/ [5759543] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:05:59 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759543/ [5759545] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:31:30 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759545/ [5759546] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:08 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759546/ [5759547] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759547/ [5759549] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:33:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759549/ [5759550] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759550/ [5759551] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:47:43 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759551/ [5759552] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759552/ [5759553] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:40 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759553/ [5759554] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:40:32 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759554/ [5759555] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:14 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759555/ [5759556] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:38 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759556/ [5759557] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:26:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759557/ [5759558] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:12:48 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759558/ [5759559] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759559/ [5759560] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} time: 01:05:47 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759560/ [5759561] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759561/ [5759562] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759562/ [5759563] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:47:24 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759563/ [5759565] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759565/ [5759566] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/failover} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759566/ [5759568] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759568/ [5759570] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759570/ [5759571] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:13 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759571/ [5759572] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:25 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759572/ [5759573] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:10:11 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759573/ [5759575] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:09:01 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759575/ [5759576] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:34:26 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759576/ [5759577] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759577/ [5759579] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:51:23 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759579/ [5759580] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:22:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759580/ [5759581] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759581/ [5759582] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759582/ [5759583] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:29:06 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759583/ [5759584] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:22:05 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759584/ [5759585] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} time: 00:17:41 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759585/ [5759586] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:18 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759586/ [5759588] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759588/ [5759589] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759589/ [5759590] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:47 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759590/ [5759591] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:49:32 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759591/ [5759592] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:52 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759592/ [5759593] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759593/ [5759595] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:36 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759595/ [5759596] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:06 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759596/ [5759597] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759597/ [5759598] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:39:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759598/ [5759599] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759599/ [5759600] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:23:12 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759600/ [5759602] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:16:02 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759602/ [5759603] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/insights} time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759603/ [5759604] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/osd} time: 03:16:04 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759604/ [5759605] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:50 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759605/ [5759606] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759606/ [5759608] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:40:45 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759608/ [5759611] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:49:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759611/ [5759612] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:18:40 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759612/ [5759614] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:58 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759614/ [5759615] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759615/ [5759617] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:20:46 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759617/ [5759618] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:24:13 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759618/ [5759619] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759619/ [5759620] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759620/ [5759621] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:47:21 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759621/ [5759622] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759622/ [5759625] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759625/ [5759627] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759627/ [5759628] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:29:06 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759628/ [5759629] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759629/ [5759630] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759630/ [5759631] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:18 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759631/ [5759632] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:28:19 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759632/ [5759633] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:09:21 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759633/ [5759634] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:33:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759634/ [5759635] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:20 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759635/ [5759636] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:28:45 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759636/ [5759637] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:31:55 info: http://pulpito.ceph.com/teuthology-2021-01-06_07:01:02-rados-master-distro-basic-smithi/5759637/