2020-10-26T07:33:02.304 INFO:root:teuthology version: 1.0.0-f4fe713 2020-10-26T07:33:02.306 INFO:teuthology.results:subset: '22/100000' 2020-10-26T07:33:02.306 INFO:teuthology.results:seed: '6222' 2020-10-26T10:52:10.016 INFO:root:teuthology version: 1.0.0-f4fe713 2020-10-26T10:52:10.052 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-10-26T22:06:33.724 INFO:teuthology.results:Tests finished! gathering results... 2020-10-26T22:07:16.283 INFO:scrape:Found 367 jobs 2020-10-26T22:07:18.637 INFO:scrape:Found 5 distinct failure reasons 2020-10-26T22:07:18.639 INFO:scrape:Failure: "2020-10-26T09:57:29.738589+0000 osd.7 (osd.7) 135 : cluster [ERR] scrub 58.1d 58:be611aa6:test-rados-api-smithi142-58022-74::foo:24 : size 0 != clone_size 10" in cluster log 2020-10-26T22:07:18.639 INFO:scrape:1 jobs: ['5560104'] 2020-10-26T22:07:18.640 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-active-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/default', 'thrashosds-health', 'workloads/rados_api_tests}'] 2020-10-26T22:07:18.640 INFO:scrape: 2020-10-26T22:07:18.640 INFO:scrape:Failure: failed to reach quorum size 9 before timeout expired 2020-10-26T22:07:18.641 INFO:scrape:1 jobs: ['5560094'] 2020-10-26T22:07:18.641 INFO:scrape:suites: ['clusters/9-mons', 'mon_election/connectivity', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/force-sync-many', 'workloads/rados_mon_osdmap_prune}'] 2020-10-26T22:07:18.641 INFO:scrape: 2020-10-26T22:07:18.641 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/mon/caps.sh 2020-10-26T22:07:18.642 INFO:scrape:1 jobs: ['5560134'] 2020-10-26T22:07:18.642 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'thrashers/many', 'workloads/rados_mon_workunits}'] 2020-10-26T22:07:18.642 INFO:scrape: 2020-10-26T22:07:18.643 INFO:scrape:Dead: b'2020-10-26T22:04:16.313 DEBUG:teuthology.exit:Finished running handlers' 2020-10-26T22:07:18.643 INFO:scrape:2 jobs: ['5560178', '5559959'] 2020-10-26T22:07:18.643 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'msgr-failures/fastclose', 'openstack}', 'rados', 'thrashosds-health'] 2020-10-26T22:07:18.644 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'fast/fast', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'recovery-overrides/{default}', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-small-objects-overwrites}'] 2020-10-26T22:07:18.644 INFO:scrape: 2020-10-26T22:07:18.645 INFO:scrape:Failure: "2020-10-26T09:58:38.912502+0000 mon.b (mon.0) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log 2020-10-26T22:07:18.645 INFO:scrape:1 jobs: ['5560141'] 2020-10-26T22:07:18.645 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/none', 'thrashosds-health', 'workloads/redirect}'] 2020-10-26T22:07:18.646 INFO:scrape: 2020-10-26T22:07:18.659 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/ failed: 4 dead: 2 running: 0 waiting: 0 queued: 0 passed: 361 Fail ================================================================= [5560094] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:48:30 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560094/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560094/ failed to reach quorum size 9 before timeout expired [5560104] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:34:07 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560104/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560104/ "2020-10-26T09:57:29.738589+0000 osd.7 (osd.7) 135 : cluster [ERR] scrub 58.1d 58:be611aa6:test-rados-api-smithi142-58022-74::foo:24 : size 0 != clone_size 10" in cluster log [5560134] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 03:22:07 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560134/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560134/ sentry: https://sentry.ceph.com/sentry/sepia/?query=cde1a60182334f609026c5d2f381ee0c Command failed (workunit test mon/caps.sh) on smithi200 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=07019beeadc788ff5fc224fc4eb49ce5500ee238 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh' [5560141] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect} ----------------------------------------------------------------- time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560141/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560141/ "2020-10-26T09:58:38.912502+0000 mon.b (mon.0) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log Dead ================================================================= [5559959] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559959/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559959/ [5560178] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560178/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560178/ Pass ================================================================= [5559926] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:04:30 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559926/ [5559927] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559927/ [5559928] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559928/ [5559929] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559929/ [5559930] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:17:03 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559930/ [5559931] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} time: 00:05:57 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559931/ [5559932] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:15:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559932/ [5559933] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559933/ [5559934] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559934/ [5559935] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:18:53 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559935/ [5559936] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:22:39 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559936/ [5559937] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:24:17 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559937/ [5559938] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:19:04 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559938/ [5559939] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:20:08 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559939/ [5559940] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559940/ [5559941] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 01:05:58 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559941/ [5559942] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:07:17 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559942/ [5559943] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:33:11 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559943/ [5559944] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:04:15 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559944/ [5559945] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559945/ [5559946] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559946/ [5559947] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559947/ [5559948] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559948/ [5559949] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:32:48 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559949/ [5559950] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:17:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559950/ [5559951] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/snaps-few-objects} time: 00:33:22 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559951/ [5559952] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:18:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559952/ [5559953] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559953/ [5559954] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:24 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559954/ [5559955] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind} time: 00:50:34 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559955/ [5559956] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:02 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559956/ [5559957] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:26:19 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559957/ [5559958] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:38:28 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559958/ [5559960] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559960/ [5559961] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559961/ [5559962] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559962/ [5559963] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:12 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559963/ [5559964] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic} time: 00:18:27 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559964/ [5559965] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:19:32 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559965/ [5559966] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:24:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559966/ [5559967] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:05:03 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559967/ [5559968] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:34:49 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559968/ [5559969] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:17 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559969/ [5559970] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:10:17 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559970/ [5559971] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:18:45 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559971/ [5559972] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:34:21 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559972/ [5559973] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:39:59 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559973/ [5559974] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559974/ [5559975] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:22 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559975/ [5559976] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli} time: 00:15:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559976/ [5559977] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559977/ [5559978] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:23:06 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559978/ [5559979] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:23:18 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559979/ [5559980] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559980/ [5559981] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:08:37 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559981/ [5559982] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/failover} time: 00:13:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559982/ [5559983] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559983/ [5559984] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/pool-create-delete} time: 00:20:23 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559984/ [5559985] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:14:57 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559985/ [5559986] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:10:35 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559986/ [5559987] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:19 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559987/ [5559988] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:09:52 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559988/ [5559989] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559989/ [5559990] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep} time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559990/ [5559991] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559991/ [5559992] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559992/ [5559993] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:17 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559993/ [5559994] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:34 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559994/ [5559995] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:22:51 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559995/ [5559996] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:27 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559996/ [5559997] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:09:59 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559997/ [5559998] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:07 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559998/ [5559999] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5559999/ [5560000] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mgr} time: 00:15:55 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560000/ [5560001] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560001/ [5560002] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:05:12 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560002/ [5560003] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:37:33 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560003/ [5560004] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:29:35 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560004/ [5560005] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption} time: 00:08:41 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560005/ [5560006] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:13:00 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560006/ [5560007] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:05 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560007/ [5560008] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity} time: 00:19:06 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560008/ [5560009] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:04:55 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560009/ [5560010] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:24:33 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560010/ [5560011] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:09:58 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560011/ [5560012] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:23:25 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560012/ [5560013] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560013/ [5560014] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/insights} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560014/ [5560015] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:32 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560015/ [5560016] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560016/ [5560017] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:06 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560017/ [5560018] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560018/ [5560019] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:31:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560019/ [5560020] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} time: 00:07:52 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560020/ [5560021] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560021/ [5560022] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560022/ [5560023] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/radosbench} time: 01:04:00 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560023/ [5560024] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:24:19 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560024/ [5560025] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:35 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560025/ [5560026] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind} time: 02:05:13 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560026/ [5560027] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560027/ [5560028] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560028/ [5560029] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:05:20 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560029/ [5560030] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:28 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560030/ [5560031] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:59 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560031/ [5560032] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560032/ [5560033] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:23:44 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560033/ [5560034] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:12 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560034/ [5560035] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560035/ [5560036] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:21:51 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560036/ [5560037] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560037/ [5560038] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:32:56 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560038/ [5560039] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560039/ [5560040] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560040/ [5560041] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560041/ [5560042] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560042/ [5560043] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560043/ [5560044] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560044/ [5560045] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:27:09 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560045/ [5560046] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:18:04 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560046/ [5560047] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:23:51 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560047/ [5560048] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:04:47 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560048/ [5560049] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:49:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560049/ [5560050] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560050/ [5560051] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:23:40 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560051/ [5560052] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:39:36 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560052/ [5560053] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560053/ [5560054] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:51 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560054/ [5560055] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_api_tests} time: 00:26:04 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560055/ [5560056] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560056/ [5560057] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:37:13 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560057/ [5560058] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560058/ [5560059] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:06:25 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560059/ [5560060] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560060/ [5560061] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:21 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560061/ [5560062] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/lockdep} time: 00:09:24 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560062/ [5560063] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:28 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560063/ [5560064] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560064/ [5560065] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:44 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560065/ [5560066] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560066/ [5560067] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560067/ [5560068] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:03 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560068/ [5560069] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:10:47 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560069/ [5560070] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:20:06 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560070/ [5560071] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:39:09 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560071/ [5560072] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:35:41 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560072/ [5560073] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:37:58 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560073/ [5560074] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:44 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560074/ [5560075] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos} time: 00:05:59 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560075/ [5560076] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560076/ [5560077] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560077/ [5560078] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:07:54 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560078/ [5560079] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:50:13 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560079/ [5560080] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:18:24 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560080/ [5560081] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache} time: 00:09:05 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560081/ [5560082] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:04:47 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560082/ [5560083] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560083/ [5560084] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:13:40 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560084/ [5560085] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560085/ [5560086] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/progress} time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560086/ [5560087] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:12 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560087/ [5560088] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560088/ [5560089] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:55 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560089/ [5560090] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:04:43 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560090/ [5560091] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560091/ [5560092] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} time: 00:34:15 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560092/ [5560093] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:29:28 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560093/ [5560095] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/connectivity} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560095/ [5560096] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560096/ [5560097] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:08:41 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560097/ [5560098] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:35 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560098/ [5560099] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/valgrind} time: 00:45:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560099/ [5560100] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:31:12 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560100/ [5560101] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:53 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560101/ [5560102] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:09:20 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560102/ [5560103] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560103/ [5560105] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:32:42 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560105/ [5560106] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli} time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560106/ [5560107] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:06 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560107/ [5560108] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:30:21 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560108/ [5560109] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:57:51 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560109/ [5560110] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:34:17 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560110/ [5560111] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} time: 00:13:08 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560111/ [5560112] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:52 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560112/ [5560113] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:47 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560113/ [5560114] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} time: 00:52:14 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560114/ [5560115] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:34:30 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560115/ [5560116] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:13:44 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560116/ [5560117] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:09:18 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560117/ [5560118] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:30:25 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560118/ [5560119] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/prometheus} time: 00:08:06 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560119/ [5560120] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:09:16 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560120/ [5560121] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:22:30 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560121/ [5560122] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:20:39 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560122/ [5560123] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:21:14 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560123/ [5560124] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:21 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560124/ [5560125] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:08:42 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560125/ [5560126] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:25:01 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560126/ [5560127] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:33:06 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560127/ [5560128] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} time: 00:19:49 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560128/ [5560129] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:05 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560129/ [5560130] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:15 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560130/ [5560131] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/crush} time: 00:15:56 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560131/ [5560132] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:48 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560132/ [5560133] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:18:50 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560133/ [5560135] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:10:12 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560135/ [5560136] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} time: 00:08:27 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560136/ [5560137] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560137/ [5560138] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:18:31 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560138/ [5560139] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560139/ [5560140] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} time: 00:18:42 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560140/ [5560142] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560142/ [5560143] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:13:21 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560143/ [5560144] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560144/ [5560145] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:12:13 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560145/ [5560146] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560146/ [5560147] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:12:08 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560147/ [5560148] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:04:22 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560148/ [5560149] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:06:50 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560149/ [5560150] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:21:04 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560150/ [5560151] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560151/ [5560152] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic} time: 00:18:20 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560152/ [5560153] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560153/ [5560154] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:36:13 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560154/ [5560155] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:08:14 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560155/ [5560156] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:33:45 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560156/ [5560157] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:42:11 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560157/ [5560158] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:14 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560158/ [5560159] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:11:52 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560159/ [5560160] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:10:35 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560160/ [5560161] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560161/ [5560162] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:55 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560162/ [5560163] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:19:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560163/ [5560164] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:29:22 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560164/ [5560165] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:37 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560165/ [5560166] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:33:50 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560166/ [5560167] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:21:37 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560167/ [5560168] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:02 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560168/ [5560169] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:24:33 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560169/ [5560170] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 00:59:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560170/ [5560171] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560171/ [5560172] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:16:53 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560172/ [5560173] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:55 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560173/ [5560174] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:43 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560174/ [5560175] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560175/ [5560176] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:16:17 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560176/ [5560177] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:09:06 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560177/ [5560179] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} time: 00:14:04 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560179/ [5560180] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:18:58 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560180/ [5560181] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mgr} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560181/ [5560182] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560182/ [5560183] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560183/ [5560184] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:05:23 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560184/ [5560185] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560185/ [5560186] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:13:43 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560186/ [5560187] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} time: 00:16:21 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560187/ [5560188] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/crash} time: 00:07:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560188/ [5560189] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:03:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560189/ [5560190] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:11:11 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560190/ [5560191] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:16:28 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560191/ [5560192] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:05:22 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560192/ [5560193] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560193/ [5560194] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:37:33 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560194/ [5560195] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:05:53 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560195/ [5560196] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:25:14 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560196/ [5560197] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:18 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560197/ [5560198] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:13 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560198/ [5560199] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560199/ [5560200] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560200/ [5560201] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560201/ [5560202] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} time: 00:13:30 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560202/ [5560203] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:10:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560203/ [5560204] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:30:57 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560204/ [5560205] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:14:05 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560205/ [5560206] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:21:34 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560206/ [5560207] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:07:49 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560207/ [5560208] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:22:49 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560208/ [5560209] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560209/ [5560210] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/misc} time: 00:29:32 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560210/ [5560211] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:07 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560211/ [5560212] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:59:01 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560212/ [5560213] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} time: 00:05:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560213/ [5560214] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:13:47 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560214/ [5560215] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:05:47 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560215/ [5560216] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:25:58 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560216/ [5560217] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560217/ [5560218] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:31:20 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560218/ [5560219] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560219/ [5560220] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} time: 01:25:56 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560220/ [5560221] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:32:55 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560221/ [5560222] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560222/ [5560223] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:09:08 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560223/ [5560224] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:17:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560224/ [5560225] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:06:39 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560225/ [5560226] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560226/ [5560227] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:30:53 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560227/ [5560228] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:24:08 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560228/ [5560229] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:05:07 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560229/ [5560230] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:20:15 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560230/ [5560231] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560231/ [5560232] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:03:35 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560232/ [5560233] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:23:24 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560233/ [5560234] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560234/ [5560235] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mon} time: 00:46:22 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560235/ [5560236] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560236/ [5560237] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:19:39 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560237/ [5560238] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:37 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560238/ [5560239] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:18:56 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560239/ [5560240] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:12 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560240/ [5560241] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560241/ [5560242] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:29:58 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560242/ [5560243] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:33:34 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560243/ [5560244] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560244/ [5560245] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:05:57 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560245/ [5560246] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:08:56 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560246/ [5560247] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:49 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560247/ [5560248] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:17:16 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560248/ [5560249] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} time: 00:16:25 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560249/ [5560250] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560250/ [5560251] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560251/ [5560252] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560252/ [5560253] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:58:49 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560253/ [5560254] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560254/ [5560255] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:15:04 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560255/ [5560256] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:36:07 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560256/ [5560257] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:03 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560257/ [5560258] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:08:53 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560258/ [5560259] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/osd} time: 03:06:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560259/ [5560260] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:03 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560260/ [5560261] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:14 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560261/ [5560262] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:31:47 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560262/ [5560263] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:23:47 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560263/ [5560264] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:13:34 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560264/ [5560265] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:19:11 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560265/ [5560266] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:11 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560266/ [5560267] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:06:20 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560267/ [5560268] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:13:57 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560268/ [5560269] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:17:56 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560269/ [5560270] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560270/ [5560271] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:03:14 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560271/ [5560272] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 05:08:27 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560272/ [5560273] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:16:16 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560273/ [5560274] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:24:23 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560274/ [5560275] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} time: 00:08:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560275/ [5560276] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:28:57 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560276/ [5560277] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560277/ [5560278] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560278/ [5560279] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560279/ [5560280] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560280/ [5560281] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:26:20 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560281/ [5560282] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560282/ [5560283] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:56 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560283/ [5560284] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560284/ [5560285] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560285/ [5560286] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:11:42 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560286/ [5560287] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:32:18 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560287/ [5560288] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:12:26 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560288/ [5560289] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:15:10 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560289/ [5560290] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:33:39 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560290/ [5560291] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:25:54 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560291/ [5560292] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 00:58:38 info: http://pulpito.ceph.com/teuthology-2020-10-26_07:01:01-rados-master-distro-basic-smithi/5560292/