2020-12-01T21:26:30.763 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-12-01T21:26:30.765 INFO:teuthology.results:subset: '2/100000' 2020-12-01T21:26:30.766 INFO:teuthology.results:seed: '7806' 2020-12-02T00:03:38.170 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-12-02T00:03:38.517 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-12-02T11:24:03.799 INFO:teuthology.results:Tests finished! gathering results... 2020-12-02T11:24:46.819 INFO:scrape:Found 367 jobs 2020-12-02T11:24:57.130 INFO:scrape:Found 12 distinct failure reasons 2020-12-02T11:24:57.131 INFO:scrape:Failure: Command failed on smithi006 with status 5: 'sudo systemctl stop ceph-a740878c-3429-11eb-980d-001a4aab830c@mon.a' 2020-12-02T11:24:57.131 INFO:scrape:2 jobs: ['5671571', '5671525'] 2020-12-02T11:24:57.132 INFO:scrape:suites intersection: ['2-repo_digest/defaut', '3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2020-12-02T11:24:57.132 INFO:scrape:suites union: ['2-repo_digest/defaut', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_18.04_podman}', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-12-02T11:24:57.133 INFO:scrape: 2020-12-02T11:24:57.133 INFO:scrape:Dead: b'2020-12-02T11:21:21.355 DEBUG:teuthology.exit:Finished running handlers' 2020-12-02T11:24:57.133 INFO:scrape:1 jobs: ['5671627'] 2020-12-02T11:24:57.134 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/normal', 'mon_election/connectivity', 'msgr-failures/fastclose', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-async-partial-recovery}', 'supported-random-distro$/{centos_8}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-radosbench}'] 2020-12-02T11:24:57.134 INFO:scrape: 2020-12-02T11:24:57.135 INFO:scrape:Failure: Command failed (workunit test osd/osd-backfill-stats.sh) on smithi134 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill-stats.sh' 2020-12-02T11:24:57.135 INFO:scrape:1 jobs: ['5671503'] 2020-12-02T11:24:57.136 INFO:scrape:suites: ['rados/standalone/{mon_election/connectivity', 'supported-random-distro$/{ubuntu_latest}', 'workloads/osd}'] 2020-12-02T11:24:57.136 INFO:scrape: 2020-12-02T11:24:57.136 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/mon/caps.sh 2020-12-02T11:24:57.137 INFO:scrape:2 jobs: ['5671483', '5671701'] 2020-12-02T11:24:57.137 INFO:scrape:suites intersection: ['clusters/9-mons', 'mon_election/connectivity', 'msgr-failures/mon-delay', 'msgr/async', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'workloads/rados_mon_workunits}'] 2020-12-02T11:24:57.138 INFO:scrape:suites union: ['clusters/9-mons', 'mon_election/connectivity', 'msgr-failures/mon-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/sync', 'thrashers/sync-many', 'workloads/rados_mon_workunits}'] 2020-12-02T11:24:57.138 INFO:scrape: 2020-12-02T11:24:57.139 INFO:scrape:Failure: Command failed on smithi099 with status 100: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo apt update'" 2020-12-02T11:24:57.139 INFO:scrape:5 jobs: ['5671705', '5671681', '5671639', '5671611', '5671695'] 2020-12-02T11:24:57.139 INFO:scrape:suites intersection: [] 2020-12-02T11:24:57.140 INFO:scrape:suites union: ['fixed-2', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman', 'rados/cephadm/smoke/{distro/ubuntu_18.04_podman', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'start', 'start}', 'task/test_adoption}', 'task/test_cephadm_repos}', 'tasks/rados_python}'] 2020-12-02T11:24:57.140 INFO:scrape: 2020-12-02T11:24:57.141 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi001 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2020-12-02T11:24:57.141 INFO:scrape:3 jobs: ['5671651', '5671382', '5671506'] 2020-12-02T11:24:57.141 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2020-12-02T11:24:57.142 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2020-12-02T11:24:57.142 INFO:scrape: 2020-12-02T11:24:57.143 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi161 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2020-12-02T11:24:57.143 INFO:scrape:2 jobs: ['5671383', '5671564'] 2020-12-02T11:24:57.144 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-12-02T11:24:57.144 INFO:scrape:suites union: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2020-12-02T11:24:57.144 INFO:scrape: 2020-12-02T11:24:57.145 INFO:scrape:Failure: Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) 2020-12-02T11:24:57.145 INFO:scrape:1 jobs: ['5671451'] 2020-12-02T11:24:57.145 INFO:scrape:suites: ['mon_election/classic', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_orch_cli}'] 2020-12-02T11:24:57.146 INFO:scrape: 2020-12-02T11:24:57.146 INFO:scrape:Failure: '/home/ubuntu/cephtest/archive/syslog/misc.log:2020-12-01T22:16:35.994871+00:00 smithi051 bash[8495]: debug 2020-12-01T22:16:35.988+0000 7f8b91292700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... ' in syslog 2020-12-02T11:24:57.147 INFO:scrape:1 jobs: ['5671430'] 2020-12-02T11:24:57.147 INFO:scrape:suites: ['2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_18.04_podman}', 'fixed-2', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-12-02T11:24:57.148 INFO:scrape: 2020-12-02T11:24:57.148 INFO:scrape:Failure: "2020-12-01T21:51:34.427909+0000 mon.b (mon.0) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log 2020-12-02T11:24:57.149 INFO:scrape:1 jobs: ['5671384'] 2020-12-02T11:24:57.149 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/snaps-few-objects-balanced}'] 2020-12-02T11:24:57.150 INFO:scrape: 2020-12-02T11:24:57.150 INFO:scrape:Failure: reached maximum tries (60) after waiting for 900 seconds 2020-12-02T11:24:57.150 INFO:scrape:4 jobs: ['5671657', '5671393', '5671621', '5671667'] 2020-12-02T11:24:57.151 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2020-12-02T11:24:57.151 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{rhel_8.0}', 'distro$/{rhel_latest}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2020-12-02T11:24:57.152 INFO:scrape: 2020-12-02T11:24:57.152 INFO:scrape:Failure: Command failed on smithi196 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:63ab00e1df82aa75a079bbfb8bbb841f07f4b47b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ff2dcef4-342f-11eb-980d-001a4aab830c -- ceph mon dump -f json' 2020-12-02T11:24:57.153 INFO:scrape:1 jobs: ['5671680'] 2020-12-02T11:24:57.153 INFO:scrape:suites: ['rados/cephadm/smoke-roleless/{distro/ubuntu_18.04', 'start}'] 2020-12-02T11:24:57.154 INFO:scrape: 2020-12-02T11:24:57.166 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/ failed: 22 dead: 2 running: 0 waiting: 0 queued: 0 passed: 343 Fail ================================================================= [5671382] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671382/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671382/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ceca08e462714013a533134ad7c22630 Command failed (workunit test cephadm/test_cephadm.sh) on smithi201 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5671383] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:24:37 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671383/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671383/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c18f979ec5b4429cb1d5c739795e673b Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi161 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5671384] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} ----------------------------------------------------------------- time: 00:26:05 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671384/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671384/ "2020-12-01T21:51:34.427909+0000 mon.b (mon.0) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log [5671393] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:19:07 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671393/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671393/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0311d9b27f1040368594be64aadae762 reached maximum tries (180) after waiting for 180 seconds [5671430] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 02:10:46 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671430/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671430/ '/home/ubuntu/cephtest/archive/syslog/misc.log:2020-12-01T22:16:35.994871+0 0:00 smithi051 bash[8495]: debug 2020-12-01T22:16:35.988+0000 7f8b91292700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr:INFO:cephadm:Deploying daemon prometheus.a ... ' in syslog [5671451] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671451/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671451/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d34cac1926f54d90b1deb0d7438b52c7 Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [5671483] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:19:48 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671483/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671483/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee844034b54249278c6aed23ea9c96c3 Command failed (workunit test mon/caps.sh) on smithi174 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' [5671503] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/osd} ----------------------------------------------------------------- time: 01:40:56 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671503/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671503/ sentry: https://sentry.ceph.com/organizations/ceph/?query=47c623b0fa3f445e9e3aece954fd0af8 Command failed (workunit test osd/osd-backfill-stats.sh) on smithi134 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-backfill- stats.sh' [5671506] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671506/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671506/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3e2b0c8567234494953481e177702f98 Command failed (workunit test cephadm/test_cephadm.sh) on smithi115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5671525] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:02:10 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671525/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671525/ sentry: https://sentry.ceph.com/organizations/ceph/?query=452e195f1c95437ebb1a4b30740a3908 Command failed on smithi136 with status 5: 'sudo systemctl stop ceph-5b7179da-3427-11eb-980d-001a4aab830c@mon.a' [5671564] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:22:53 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671564/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671564/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9210c1d60cec4589bb6c91a0d917ed5c Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi035 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5671571] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:02:06 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671571/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671571/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ca78f7a70dc4beba28b6e142c7072ef Command failed on smithi006 with status 5: 'sudo systemctl stop ceph-a740878c-3429-11eb-980d-001a4aab830c@mon.a' [5671611] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:04:04 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671611/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671611/ sentry: https://sentry.ceph.com/organizations/ceph/?query=055caec460004e6a958b3d2c655bca01 Command failed on smithi162 with status 2: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'curl -L https://download.opensuse.or g/repositories/devel:/kubic:/libcontainers:/stable/xUbuntu_18.04/Release.ke y | sudo apt-key add -'" [5671621] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671621/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671621/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ef67de2032644d2829b9a4d90ced432 reached maximum tries (180) after waiting for 180 seconds [5671639] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:25 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671639/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671639/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df526be7292e42d88ed00dc84478f02a Command failed on smithi040 with status 2: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'curl -L https://download.opensuse.or g/repositories/devel:/kubic:/libcontainers:/stable/xUbuntu_18.04/Release.ke y | sudo apt-key add -'" [5671651] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671651/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671651/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b47722f8ffd346ce915467d03bdf2013 Command failed (workunit test cephadm/test_cephadm.sh) on smithi001 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5671667] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:14:42 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671667/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671667/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa934f2f09974defa4026ba8a9fb512e reached maximum tries (180) after waiting for 180 seconds [5671680] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} ----------------------------------------------------------------- time: 00:55:02 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671680/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671680/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9418e1ae3c254e3c85e6424571d2b712 Command failed on smithi196 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:63ab00e1df82aa75a079bbfb8bbb841f07f4b47b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ff2dcef4-342f-11eb-980d-001a4aab830c -- ceph mon dump -f json' [5671681] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:04:02 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671681/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671681/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e0ef89f7649402f8c174b67c29057d5 Command failed on smithi116 with status 2: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'curl -L https://download.opensuse.or g/repositories/devel:/kubic:/libcontainers:/stable/xUbuntu_18.04/Release.ke y | sudo apt-key add -'" [5671695] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:02:06 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671695/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671695/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e55aafb1b64f45d78013505050aa2e20 Command failed on smithi014 with status 100: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo apt update'" [5671701] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:19:53 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671701/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671701/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6f2437e4219b483b8606dc35548677d5 Command failed (workunit test mon/caps.sh) on smithi086 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c9fbc794811a1de66ee254a1f9078372839e4f3 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' [5671705] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:02:14 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671705/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671705/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d871c71c64ab47e99969a57b641ea288 Command failed on smithi099 with status 100: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo apt update'" Dead ================================================================= [5671627] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671627/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671627/ [5671657] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671657/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671657/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c18b488a8c1b444391181b12e91d6c0c reached maximum tries (60) after waiting for 900 seconds Pass ================================================================= [5671362] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:20 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671362/ [5671363] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671363/ [5671364] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:18:09 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671364/ [5671365] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:20:19 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671365/ [5671366] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:22:17 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671366/ [5671367] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671367/ [5671368] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_5925} time: 00:08:22 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671368/ [5671369] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:25:27 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671369/ [5671370] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:22:35 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671370/ [5671371] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:19:15 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671371/ [5671372] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671372/ [5671373] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:07:59 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671373/ [5671374] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:36:59 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671374/ [5671375] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:22 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671375/ [5671376] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:12:58 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671376/ [5671377] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671377/ [5671378] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671378/ [5671379] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/crush} time: 00:15:39 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671379/ [5671380] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:31:25 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671380/ [5671381] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671381/ [5671385] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671385/ [5671386] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671386/ [5671387] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671387/ [5671388] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:55 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671388/ [5671389] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:04 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671389/ [5671390] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671390/ [5671391] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:43:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671391/ [5671392] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671392/ [5671394] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:07:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671394/ [5671395] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} time: 01:07:49 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671395/ [5671396] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:08:41 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671396/ [5671397] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:36:19 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671397/ [5671398] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:39:58 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671398/ [5671399] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:50 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671399/ [5671400] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} time: 00:49:40 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671400/ [5671401] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:21 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671401/ [5671402] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:19:40 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671402/ [5671403] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:28:41 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671403/ [5671404] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:19:41 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671404/ [5671405] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:39:06 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671405/ [5671406] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671406/ [5671407] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:05:54 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671407/ [5671408] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671408/ [5671409] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:57 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671409/ [5671410] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_api_tests} time: 00:34:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671410/ [5671411] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671411/ [5671412] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671412/ [5671413] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671413/ [5671414] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671414/ [5671415] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:50 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671415/ [5671416] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671416/ [5671417] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:14:59 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671417/ [5671418] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:05 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671418/ [5671419] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671419/ [5671420] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671420/ [5671421] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:34:47 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671421/ [5671422] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671422/ [5671423] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:14 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671423/ [5671424] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:26:28 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671424/ [5671425] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:44:48 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671425/ [5671426] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mgr} time: 00:15:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671426/ [5671427] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:43:13 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671427/ [5671428] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671428/ [5671429] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:05:56 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671429/ [5671431] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:06:37 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671431/ [5671432] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:47:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671432/ [5671433] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671433/ [5671434] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:19:21 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671434/ [5671435] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:47 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671435/ [5671436] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} time: 00:21:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671436/ [5671437] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:28 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671437/ [5671438] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671438/ [5671439] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:06:37 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671439/ [5671440] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671440/ [5671441] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671441/ [5671442] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671442/ [5671443] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:04:41 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671443/ [5671444] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:22:47 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671444/ [5671445] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/insights} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671445/ [5671446] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 00:51:54 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671446/ [5671447] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671447/ [5671448] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:34:26 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671448/ [5671449] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671449/ [5671450] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671450/ [5671452] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/misc} time: 00:30:21 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671452/ [5671453] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671453/ [5671454] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:11:52 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671454/ [5671455] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} time: 01:10:12 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671455/ [5671456] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}} time: 00:08:17 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671456/ [5671457] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:43 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671457/ [5671458] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:29:07 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671458/ [5671459] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:08 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671459/ [5671460] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:21:56 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671460/ [5671461] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:38 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671461/ [5671462] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:34 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671462/ [5671463] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:34:23 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671463/ [5671464] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:12:35 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671464/ [5671465] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671465/ [5671466] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:38:54 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671466/ [5671467] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:29:35 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671467/ [5671468] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:07:29 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671468/ [5671469] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:30:13 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671469/ [5671470] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:04:10 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671470/ [5671471] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671471/ [5671472] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/valgrind} time: 00:26:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671472/ [5671473] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:16 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671473/ [5671474] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671474/ [5671475] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671475/ [5671476] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:49 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671476/ [5671477] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption} time: 00:10:15 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671477/ [5671478] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:27:19 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671478/ [5671479] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mon} time: 00:43:19 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671479/ [5671480] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671480/ [5671481] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects} time: 00:21:03 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671481/ [5671482] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671482/ [5671484] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671484/ [5671485] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:23:13 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671485/ [5671486] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} time: 00:18:01 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671486/ [5671487] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671487/ [5671488] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671488/ [5671489] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:11:01 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671489/ [5671490] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:10 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671490/ [5671491] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:31 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671491/ [5671492] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671492/ [5671493] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:22:07 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671493/ [5671494] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:35:53 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671494/ [5671495] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671495/ [5671496] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671496/ [5671497] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:11:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671497/ [5671498] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:15:40 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671498/ [5671499] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:18:12 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671499/ [5671500] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:19:30 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671500/ [5671501] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671501/ [5671502] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:06 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671502/ [5671504] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671504/ [5671505] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache} time: 00:10:34 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671505/ [5671507] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:07 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671507/ [5671508] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:24 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671508/ [5671509] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/lockdep} time: 00:26:17 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671509/ [5671510] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:28 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671510/ [5671511] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:35:08 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671511/ [5671512] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/progress} time: 00:16:27 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671512/ [5671513] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671513/ [5671514] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671514/ [5671515] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:22 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671515/ [5671516] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:32:31 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671516/ [5671517] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:19:55 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671517/ [5671518] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:08:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671518/ [5671519] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/sync workloads/snaps-few-objects} time: 00:25:21 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671519/ [5671520] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:38 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671520/ [5671521] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:37 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671521/ [5671522] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:24:41 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671522/ [5671523] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671523/ [5671524] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:58 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671524/ [5671526] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:33:39 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671526/ [5671527] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:17:12 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671527/ [5671528] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:45 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671528/ [5671529] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:35:54 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671529/ [5671530] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671530/ [5671531] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:57 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671531/ [5671532] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/scrub} time: 01:42:15 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671532/ [5671533] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:19:25 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671533/ [5671534] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:28:12 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671534/ [5671535] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:14:51 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671535/ [5671536] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:16 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671536/ [5671537] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 01:07:33 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671537/ [5671538] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:25:09 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671538/ [5671539] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 01:09:36 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671539/ [5671540] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:54 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671540/ [5671541] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:36:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671541/ [5671542] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:09 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671542/ [5671543] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/valgrind} time: 02:09:18 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671543/ [5671544] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:45 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671544/ [5671545] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671545/ [5671546] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:05:32 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671546/ [5671547] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} time: 00:08:32 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671547/ [5671548] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/prometheus} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671548/ [5671549] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:29:28 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671549/ [5671550] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:46:39 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671550/ [5671551] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:05:55 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671551/ [5671552] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:53 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671552/ [5671553] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671553/ [5671554] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/pool-create-delete} time: 00:16:46 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671554/ [5671555] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671555/ [5671556] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:10:35 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671556/ [5671557] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671557/ [5671558] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:38:53 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671558/ [5671559] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:02 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671559/ [5671560] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671560/ [5671561] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/crush} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671561/ [5671562] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:41 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671562/ [5671563] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:34:43 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671563/ [5671565] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:09:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671565/ [5671566] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671566/ [5671567] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671567/ [5671568] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:14:57 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671568/ [5671569] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671569/ [5671570] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:12:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671570/ [5671572] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671572/ [5671573] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:47 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671573/ [5671574] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671574/ [5671575] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:37 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671575/ [5671576] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671576/ [5671577] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:37:28 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671577/ [5671578] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:07 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671578/ [5671579] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671579/ [5671580] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:16 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671580/ [5671581] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/lockdep} time: 00:12:37 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671581/ [5671582] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:27:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671582/ [5671583] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:12 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671583/ [5671584] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/workunits} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671584/ [5671585] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:40:01 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671585/ [5671586] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} time: 00:16:26 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671586/ [5671587] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671587/ [5671588] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671588/ [5671589] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:20:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671589/ [5671590] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:09:19 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671590/ [5671591] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:23:39 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671591/ [5671592] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671592/ [5671593] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671593/ [5671594] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_5925} time: 00:07:07 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671594/ [5671595] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:36 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671595/ [5671596] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671596/ [5671597] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671597/ [5671598] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:20:02 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671598/ [5671599] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:31:16 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671599/ [5671600] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:38 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671600/ [5671601] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671601/ [5671602] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671602/ [5671603] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671603/ [5671604] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:54 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671604/ [5671605] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671605/ [5671606] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671606/ [5671607] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671607/ [5671608] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:12:20 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671608/ [5671609] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:07:34 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671609/ [5671610] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:36:46 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671610/ [5671612] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:08:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671612/ [5671613] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:17:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671613/ [5671614] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671614/ [5671615] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/valgrind} time: 00:28:57 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671615/ [5671616] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/crash} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671616/ [5671617] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:39 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671617/ [5671618] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671618/ [5671619] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:59 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671619/ [5671620] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671620/ [5671622] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671622/ [5671623] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:25 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671623/ [5671624] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:34 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671624/ [5671625] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:40:01 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671625/ [5671626] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:12 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671626/ [5671628] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:07 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671628/ [5671629] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_api_tests} time: 00:33:29 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671629/ [5671630] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671630/ [5671631] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671631/ [5671632] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:14 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671632/ [5671633] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671633/ [5671634] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:24:36 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671634/ [5671635] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671635/ [5671636] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:18:46 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671636/ [5671637] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:29:26 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671637/ [5671638] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671638/ [5671640] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:13:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671640/ [5671641] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:26:27 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671641/ [5671642] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:21:28 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671642/ [5671643] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:12 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671643/ [5671644] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:17 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671644/ [5671645] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671645/ [5671646] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:29:10 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671646/ [5671647] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:19:57 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671647/ [5671648] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:39:01 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671648/ [5671649] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:10:23 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671649/ [5671650] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/failover} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671650/ [5671652] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:07 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671652/ [5671653] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/lockdep} time: 00:25:40 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671653/ [5671654] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:13 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671654/ [5671655] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:13 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671655/ [5671656] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:30 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671656/ [5671658] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 01:21:12 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671658/ [5671659] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:09:59 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671659/ [5671660] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:31:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671660/ [5671661] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671661/ [5671662] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:14:06 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671662/ [5671663] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:10 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671663/ [5671664] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:43 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671664/ [5671665] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:46:05 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671665/ [5671666] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:39:37 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671666/ [5671668] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671668/ [5671669] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:25:52 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671669/ [5671670] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:18:14 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671670/ [5671671] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:34:49 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671671/ [5671672] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:31:14 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671672/ [5671673] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:29:15 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671673/ [5671674] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671674/ [5671675] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671675/ [5671676] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671676/ [5671677] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:21:51 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671677/ [5671678] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:24:19 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671678/ [5671679] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:13:43 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671679/ [5671682] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:23:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671682/ [5671683] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671683/ [5671684] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671684/ [5671685] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:10:33 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671685/ [5671686] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/osd} time: 03:07:58 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671686/ [5671687] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:24:40 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671687/ [5671688] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:30:22 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671688/ [5671689] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:25:41 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671689/ [5671690] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:43 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671690/ [5671691] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/valgrind} time: 02:09:40 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671691/ [5671692] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671692/ [5671693] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:16:04 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671693/ [5671694] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:13 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671694/ [5671696] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:19 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671696/ [5671697] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:10:18 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671697/ [5671698] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:52 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671698/ [5671699] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:11:46 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671699/ [5671700] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:08:13 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671700/ [5671702] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:33:05 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671702/ [5671703] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:14:59 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671703/ [5671704] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 05:05:54 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671704/ [5671706] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/connectivity} time: 00:17:09 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671706/ [5671707] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671707/ [5671708] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:16:46 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671708/ [5671709] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671709/ [5671710] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671710/ [5671711] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:09:42 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671711/ [5671712] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:12 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671712/ [5671713] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:34:49 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671713/ [5671714] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/scrub} time: 01:43:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671714/ [5671715] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} time: 00:16:14 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671715/ [5671716] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:27:13 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671716/ [5671717] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671717/ [5671718] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 01:15:46 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671718/ [5671719] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:36:49 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671719/ [5671720] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:24:47 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671720/ [5671721] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:27:45 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671721/ [5671722] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671722/ [5671723] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:58 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671723/ [5671724] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/lockdep} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671724/ [5671725] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:51 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671725/ [5671726] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671726/ [5671727] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671727/ [5671728] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:06:26 info: http://pulpito.ceph.com/teuthology-2020-12-01_07:01:02-rados-master-distro-basic-smithi/5671728/