2020-12-10T07:14:10.404 INFO:root:teuthology version: 1.0.0-5f33661d 2020-12-10T07:14:10.406 INFO:teuthology.results:subset: '11/100000' 2020-12-10T07:14:10.406 INFO:teuthology.results:seed: '9825' 2020-12-10T10:22:07.005 INFO:root:teuthology version: 1.0.0-5f33661d 2020-12-10T10:22:07.042 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-12-10T16:07:19.050 INFO:teuthology.results:Tests finished! gathering results... 2020-12-10T16:08:12.412 INFO:scrape:Found 367 jobs 2020-12-10T16:08:19.974 INFO:scrape:Found 9 distinct failure reasons 2020-12-10T16:08:19.975 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2020-12-10T16:08:19.976 INFO:scrape:5 jobs: ['5697743', '5697797', '5697657', '5697838', '5697923'] 2020-12-10T16:08:19.976 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2020-12-10T16:08:19.977 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{centos_8.0}', 'distro$/{centos_latest}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-12-10T16:08:19.977 INFO:scrape: 2020-12-10T16:08:19.977 INFO:scrape:Failure: Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) 2020-12-10T16:08:19.978 INFO:scrape:1 jobs: ['5697666'] 2020-12-10T16:08:19.978 INFO:scrape:suites: ['mon_election/classic', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_orch_cli}'] 2020-12-10T16:08:19.979 INFO:scrape: 2020-12-10T16:08:19.979 INFO:scrape:Failure: unexpected end of data 2020-12-10T16:08:19.979 INFO:scrape:1 jobs: ['5697879'] 2020-12-10T16:08:19.980 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/default', 'thrashosds-health', 'workloads/radosbench}'] 2020-12-10T16:08:19.980 INFO:scrape: 2020-12-10T16:08:19.981 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2020-12-10T16:08:19.981 INFO:scrape:2 jobs: ['5697782', '5697595'] 2020-12-10T16:08:19.982 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-12-10T16:08:19.982 INFO:scrape:suites union: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-12-10T16:08:19.982 INFO:scrape: 2020-12-10T16:08:19.983 INFO:scrape:Failure: "2020-12-10T07:50:10.855278+0000 osd.5 (osd.5) 8 : cluster [ERR] 60.9 shard 5 soid 60:965585eb:test-rados-api-smithi175-39778-74::foo:23 : candidate size 10 info size 0 mismatch" in cluster log 2020-12-10T16:08:19.983 INFO:scrape:1 jobs: ['5697583'] 2020-12-10T16:08:19.984 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr/async-v1only', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashosds-health', 'workloads/rados_api_tests}'] 2020-12-10T16:08:19.984 INFO:scrape: 2020-12-10T16:08:19.985 INFO:scrape:Failure: Command failed (workunit test cephtool/test.sh) on smithi103 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' 2020-12-10T16:08:19.985 INFO:scrape:1 jobs: ['5697686'] 2020-12-10T16:08:19.986 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{rhel_8}}'] 2020-12-10T16:08:19.986 INFO:scrape: 2020-12-10T16:08:19.987 INFO:scrape:Failure: "2020-12-10T10:16:54.822990+0000 mon.a (mon.0) 20 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log 2020-12-10T16:08:19.987 INFO:scrape:1 jobs: ['5697910'] 2020-12-10T16:08:19.987 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/lost-unfound-delete', 'supported-random-distro$/{ubuntu_latest}}'] 2020-12-10T16:08:19.988 INFO:scrape: 2020-12-10T16:08:19.988 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on smithi156 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2020-12-10T16:08:19.989 INFO:scrape:2 jobs: ['5697696', '5697835'] 2020-12-10T16:08:19.989 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2020-12-10T16:08:19.989 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2020-12-10T16:08:19.990 INFO:scrape: 2020-12-10T16:08:19.990 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi082 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2020-12-10T16:08:19.991 INFO:scrape:1 jobs: ['5697580'] 2020-12-10T16:08:19.991 INFO:scrape:suites: ['mon_election/classic', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2020-12-10T16:08:19.992 INFO:scrape: 2020-12-10T16:08:20.003 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/ failed: 15 dead: 0 running: 0 waiting: 0 queued: 0 passed: 352 Fail ================================================================= [5697580] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697580/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697580/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4299a2753bf247339f65cdd5c8f12353 Command failed (workunit test cephadm/test_cephadm.sh) on smithi082 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5697583] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:30:27 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697583/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697583/ "2020-12-10T07:50:10.855278+0000 osd.5 (osd.5) 8 : cluster [ERR] 60.9 shard 5 soid 60:965585eb:test-rados-api-smithi175-39778-74::foo:23 : candidate size 10 info size 0 mismatch" in cluster log [5697595] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:26:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697595/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697595/ sentry: https://sentry.ceph.com/organizations/ceph/?query=895d6a5b86b744a3810ddaa2fb6c7562 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi164 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5697657] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697657/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697657/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa22cb3632214adab7f7b3b82475b0f1 reached maximum tries (180) after waiting for 180 seconds [5697666] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:11:38 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697666/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697666/ sentry: https://sentry.ceph.com/organizations/ceph/?query=839cc80823db4ab087309427c04e198c Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [5697686] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:35:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697686/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697686/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c562d51376f947d49c286e413ef43be3 Command failed (workunit test cephtool/test.sh) on smithi103 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' [5697696] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697696/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697696/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f9f4a81d602546129fb93b7c0f6ed1e7 Command failed (workunit test cephadm/test_adoption.sh) on smithi156 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5697743] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697743/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697743/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82650d2e7b334991a70d6bf68cfa0e02 reached maximum tries (180) after waiting for 180 seconds [5697782] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697782/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697782/ sentry: https://sentry.ceph.com/organizations/ceph/?query=52bb6a353389439cbb015bb0869114f5 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5697797] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697797/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697797/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4348aad775c646ddb0933fb33b39ba26 reached maximum tries (180) after waiting for 180 seconds [5697835] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697835/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697835/ sentry: https://sentry.ceph.com/organizations/ceph/?query=60c702efde834492841263d1a1d66267 Command failed (workunit test cephadm/test_adoption.sh) on smithi052 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b2d0ea1d5b32eb3b33286cacbf46d7e7c01ced27 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5697838] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697838/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697838/ sentry: https://sentry.ceph.com/organizations/ceph/?query=496c2b9e6e9f4aa293f8551a8713913c reached maximum tries (180) after waiting for 180 seconds [5697879] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 01:39:50 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697879/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697879/ unexpected end of data [5697910] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:46:29 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697910/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697910/ "2020-12-10T10:16:54.822990+0000 mon.a (mon.0) 20 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log [5697923] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:16:41 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697923/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697923/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b1feda546df4c25b53a9864ca9a6df0 reached maximum tries (180) after waiting for 180 seconds Pass ================================================================= [5697571] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:26 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697571/ [5697572] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:43 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697572/ [5697573] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} time: 00:28:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697573/ [5697574] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697574/ [5697575] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:09:52 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697575/ [5697576] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:27:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697576/ [5697577] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697577/ [5697578] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697578/ [5697579] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697579/ [5697581] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:28:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697581/ [5697582] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:10:00 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697582/ [5697584] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:41:27 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697584/ [5697585] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:41:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697585/ [5697586] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:05:18 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697586/ [5697587] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:14:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697587/ [5697588] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697588/ [5697589] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:26 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697589/ [5697590] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697590/ [5697591] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:03:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697591/ [5697592] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:19:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697592/ [5697593] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:35:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697593/ [5697594] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:25:33 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697594/ [5697596] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697596/ [5697597] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697597/ [5697598] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 01:07:14 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697598/ [5697599] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697599/ [5697600] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697600/ [5697601] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:07 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697601/ [5697602] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:22:31 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697602/ [5697603] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697603/ [5697604] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/progress} time: 00:14:47 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697604/ [5697605] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697605/ [5697606] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697606/ [5697607] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 01:04:06 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697607/ [5697608] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:44 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697608/ [5697609] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:16 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697609/ [5697610] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} time: 00:30:05 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697610/ [5697611] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 02:35:31 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697611/ [5697612] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:49 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697612/ [5697613] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic} time: 00:17:13 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697613/ [5697614] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:35 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697614/ [5697615] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:15:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697615/ [5697616] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:42:06 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697616/ [5697617] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:23:56 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697617/ [5697618] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:13:22 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697618/ [5697619] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697619/ [5697620] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697620/ [5697622] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697622/ [5697624] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:10:47 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697624/ [5697625] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:27:53 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697625/ [5697627] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:22 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697627/ [5697629] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697629/ [5697631] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697631/ [5697633] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697633/ [5697634] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:05:58 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697634/ [5697635] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:12:30 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697635/ [5697636] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697636/ [5697637] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697637/ [5697638] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697638/ [5697639] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697639/ [5697640] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:36:06 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697640/ [5697641] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697641/ [5697642] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:53 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697642/ [5697643] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697643/ [5697644] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:25:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697644/ [5697645] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697645/ [5697646] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/prometheus} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697646/ [5697647] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mgr} time: 00:16:46 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697647/ [5697648] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697648/ [5697649] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:33:08 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697649/ [5697650] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697650/ [5697651] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:38:08 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697651/ [5697652] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697652/ [5697653] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697653/ [5697654] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 02:15:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697654/ [5697655] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:24:03 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697655/ [5697656] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:33 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697656/ [5697658] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697658/ [5697659] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:20:05 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697659/ [5697660] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:55 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697660/ [5697661] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697661/ [5697662] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:15:23 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697662/ [5697663] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697663/ [5697664] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:32 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697664/ [5697665] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697665/ [5697667] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697667/ [5697668] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697668/ [5697669] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:14:06 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697669/ [5697670] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:21:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697670/ [5697671] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:31:33 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697671/ [5697672] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:08:55 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697672/ [5697673] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697673/ [5697674] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697674/ [5697675] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:34 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697675/ [5697676] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:32:13 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697676/ [5697677] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697677/ [5697678] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:08:19 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697678/ [5697679] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697679/ [5697680] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/workunits} time: 00:14:14 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697680/ [5697681] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:23:04 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697681/ [5697682] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:00 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697682/ [5697683] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:16:36 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697683/ [5697684] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697684/ [5697685] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:22:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697685/ [5697687] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:32:07 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697687/ [5697688] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697688/ [5697689] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:07 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697689/ [5697690] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697690/ [5697691] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:18 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697691/ [5697692] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697692/ [5697693] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697693/ [5697694] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:10:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697694/ [5697695] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:17:26 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697695/ [5697697] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:21:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697697/ [5697698] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:41 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697698/ [5697699] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:14:21 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697699/ [5697700] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mon} time: 00:46:47 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697700/ [5697701] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:15:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697701/ [5697702] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} time: 00:17:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697702/ [5697703] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697703/ [5697704] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:08:28 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697704/ [5697705] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:28:11 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697705/ [5697706] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:14 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697706/ [5697707] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697707/ [5697708] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697708/ [5697709] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:07:16 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697709/ [5697710] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697710/ [5697711] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:16:28 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697711/ [5697712] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697712/ [5697713] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/crash} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697713/ [5697714] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:05:39 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697714/ [5697715] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:36:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697715/ [5697716] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697716/ [5697717] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:13 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697717/ [5697718] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:32:49 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697718/ [5697719] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:21:04 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697719/ [5697720] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697720/ [5697721] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:38:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697721/ [5697722] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/pool-create-delete} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697722/ [5697723] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:22:04 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697723/ [5697724] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:34:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697724/ [5697725] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:47 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697725/ [5697726] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} time: 00:51:53 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697726/ [5697727] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697727/ [5697728] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/osd} time: 03:10:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697728/ [5697729] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:41 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697729/ [5697730] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697730/ [5697731] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:31:38 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697731/ [5697732] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697732/ [5697733] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:16:36 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697733/ [5697734] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697734/ [5697735] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:08 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697735/ [5697736] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697736/ [5697737] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697737/ [5697738] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697738/ [5697739] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697739/ [5697740] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:07 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697740/ [5697741] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697741/ [5697742] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:35:43 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697742/ [5697744] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:21:22 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697744/ [5697745] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697745/ [5697746] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:30:07 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697746/ [5697747] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/failover} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697747/ [5697748] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/scrub} time: 01:44:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697748/ [5697749] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:16 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697749/ [5697750] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697750/ [5697751] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:08:52 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697751/ [5697752] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 02:22:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697752/ [5697753] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697753/ [5697754] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:19:32 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697754/ [5697755] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:29:28 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697755/ [5697756] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:14 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697756/ [5697757] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} time: 02:03:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697757/ [5697758] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697758/ [5697759] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697759/ [5697760] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_5925} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697760/ [5697761] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697761/ [5697762] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} time: 00:21:40 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697762/ [5697763] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697763/ [5697764] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:12:00 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697764/ [5697765] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:23:33 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697765/ [5697766] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697766/ [5697767] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697767/ [5697768] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697768/ [5697769] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:38:18 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697769/ [5697770] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697770/ [5697771] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697771/ [5697772] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697772/ [5697773] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:18:19 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697773/ [5697774] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:12:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697774/ [5697775] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:41:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697775/ [5697776] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:47 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697776/ [5697777] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:19 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697777/ [5697778] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/crush} time: 00:17:06 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697778/ [5697779] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 04:54:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697779/ [5697780] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:31:08 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697780/ [5697781] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697781/ [5697783] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 01:27:43 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697783/ [5697784] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697784/ [5697785] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/insights} time: 00:13:28 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697785/ [5697786] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:31:14 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697786/ [5697787] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697787/ [5697788] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697788/ [5697789] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:14:21 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697789/ [5697790] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:23:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697790/ [5697791] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697791/ [5697792] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697792/ [5697793] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:47:08 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697793/ [5697794] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_api_tests} time: 00:37:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697794/ [5697795] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697795/ [5697796] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} time: 02:16:43 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697796/ [5697798] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:27:00 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697798/ [5697799] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:06:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697799/ [5697800] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697800/ [5697801] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:29 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697801/ [5697802] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:00 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697802/ [5697803] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} time: 01:56:46 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697803/ [5697804] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:43:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697804/ [5697805] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697805/ [5697806] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697806/ [5697807] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:37:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697807/ [5697808] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697808/ [5697809] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:26:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697809/ [5697810] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} time: 00:18:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697810/ [5697811] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:22:12 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697811/ [5697812] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697812/ [5697813] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:13:35 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697813/ [5697814] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:30:55 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697814/ [5697815] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697815/ [5697816] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 01:09:34 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697816/ [5697817] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697817/ [5697818] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697818/ [5697819] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697819/ [5697820] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:29 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697820/ [5697821] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:24:03 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697821/ [5697822] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697822/ [5697823] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697823/ [5697824] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:48 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697824/ [5697825] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697825/ [5697826] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:38:50 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697826/ [5697827] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:14:46 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697827/ [5697828] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:12:49 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697828/ [5697829] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:08:49 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697829/ [5697830] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697830/ [5697831] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 01:06:16 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697831/ [5697832] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:00 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697832/ [5697833] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697833/ [5697834] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:31 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697834/ [5697836] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697836/ [5697837] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:05:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697837/ [5697839] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} time: 01:09:04 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697839/ [5697840] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:14:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697840/ [5697841] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:00 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697841/ [5697842] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:19:28 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697842/ [5697843] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697843/ [5697844] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:35:38 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697844/ [5697845] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697845/ [5697846] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697846/ [5697847] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:13:24 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697847/ [5697848] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697848/ [5697849] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697849/ [5697850] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697850/ [5697851] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697851/ [5697852] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:27:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697852/ [5697853] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:33:18 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697853/ [5697854] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/progress} time: 00:18:40 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697854/ [5697855] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/misc} time: 00:33:58 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697855/ [5697856] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:09:04 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697856/ [5697857] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697857/ [5697858] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:05:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697858/ [5697859] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:15:50 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697859/ [5697860] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697860/ [5697861] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:28:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697861/ [5697862] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697862/ [5697863] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:13:14 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697863/ [5697864] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:14:53 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697864/ [5697865] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:44:41 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697865/ [5697866] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697866/ [5697867] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697867/ [5697868] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:30:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697868/ [5697869] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:40:03 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697869/ [5697870] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697870/ [5697871] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} time: 00:54:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697871/ [5697872] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697872/ [5697873] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} time: 00:19:12 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697873/ [5697874] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697874/ [5697875] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:45 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697875/ [5697876] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697876/ [5697877] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:38:20 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697877/ [5697878] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:07:43 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697878/ [5697880] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:09:27 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697880/ [5697881] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:29:19 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697881/ [5697882] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:32:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697882/ [5697883] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mon} time: 00:45:31 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697883/ [5697884] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:14:26 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697884/ [5697885] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697885/ [5697886] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:39:18 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697886/ [5697887] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic} time: 00:19:10 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697887/ [5697888] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:11:05 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697888/ [5697889] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697889/ [5697890] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:13:58 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697890/ [5697891] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:29:31 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697891/ [5697892] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697892/ [5697893] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697893/ [5697894] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697894/ [5697895] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697895/ [5697896] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697896/ [5697897] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:29:44 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697897/ [5697898] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697898/ [5697899] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:21:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697899/ [5697900] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/dashboard} time: 01:09:00 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697900/ [5697901] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:15:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697901/ [5697902] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:30:06 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697902/ [5697903] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/snaps-few-objects} time: 00:28:53 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697903/ [5697904] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:59 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697904/ [5697905] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:25:53 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697905/ [5697906] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697906/ [5697907] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:59 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697907/ [5697908] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697908/ [5697909] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:22:53 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697909/ [5697911] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/osd} time: 03:07:31 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697911/ [5697912] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697912/ [5697913] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697913/ [5697914] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:19:44 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697914/ [5697915] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697915/ [5697916] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:51:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697916/ [5697917] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697917/ [5697918] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:18 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697918/ [5697919] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:39 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697919/ [5697920] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 05:14:01 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697920/ [5697921] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697921/ [5697922] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697922/ [5697924] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:11:48 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697924/ [5697925] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:36:39 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697925/ [5697926] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697926/ [5697927] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:38:39 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697927/ [5697928] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:39 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697928/ [5697929] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697929/ [5697930] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:19:02 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697930/ [5697931] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:45:19 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697931/ [5697932] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:51 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697932/ [5697933] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:41:52 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697933/ [5697934] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:39:52 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697934/ [5697935] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697935/ [5697936] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:28:42 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697936/ [5697937] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697937/ [5697938] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 01:07:49 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697938/ [5697939] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697939/ [5697940] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:25:28 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697940/ [5697941] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:18 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697941/ [5697942] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:27:27 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697942/ [5697943] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/pool-create-delete} time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2020-12-10_07:01:01-rados-master-distro-basic-smithi/5697943/