2019-12-03T02:47:03.513 INFO:root:teuthology version: 1.0.0-e0b5789 2019-12-03T02:47:03.513 INFO:teuthology.results:subset: '1/40' 2019-12-03T02:47:03.513 INFO:teuthology.results:seed: '9208' 2019-12-03T15:13:19.629 INFO:root:teuthology version: 1.0.0-e0b5789 2019-12-03T15:13:19.671 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2019-12-03T16:08:20.601 INFO:teuthology.results:Tests finished! gathering results... 2019-12-03T16:08:20.742 INFO:teuthology.results:Sending results to gfarnum@redhat.com: Test Run: gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira ================================================================= info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/ logs: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/ failed: 17 dead: 1 running: 0 waiting: 0 queued: 0 passed: 36 Fail ================================================================= [4563018] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/one.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:39:14 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563018/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563018/ "2019-12-03T10:51:47.336358+0000 mon.a (mon.0) 167 : cluster [WRN] Health check failed: 1 pool(s) have no replicas configured (POOL_NO_REDUNDANCY)" in cluster log [4563042] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:29:38 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563042/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563042/ "2019-12-03T15:12:13.765784+0000 mon.b (mon.1) 145 : cluster [WRN] Health check failed: 1 pool(s) have no replicas configured (POOL_NO_REDUNDANCY)" in cluster log [4563040] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:33:17 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563040/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563040/ Command failed (workunit test rados/test.sh) on mira072 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35b0b52153206fd6178afe584a2cd9c0ef2bcc05 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4563010] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:35:58 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563010/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563010/ Command failed (workunit test rados/test.sh) on mira083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35b0b52153206fd6178afe584a2cd9c0ef2bcc05 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4563000] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:28:56 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563000/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563000/ "2019-12-03T04:56:55.749969+0000 mon.a (mon.0) 128 : cluster [WRN] Health check failed: 1 pool(s) have no replicas configured (POOL_NO_REDUNDANCY)" in cluster log [4563006] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:39:18 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563006/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563006/ "2019-12-03T06:35:26.720700+0000 mon.a (mon.0) 129 : cluster [WRN] Health check failed: 1 pool(s) have no replicas configured (POOL_NO_REDUNDANCY)" in cluster log [4563016] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:37:27 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563016/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563016/ Command failed (workunit test rados/test.sh) on mira109 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35b0b52153206fd6178afe584a2cd9c0ef2bcc05 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4563004] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync-many.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:34:34 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563004/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563004/ Command failed (workunit test rados/test.sh) on mira105 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35b0b52153206fd6178afe584a2cd9c0ef2bcc05 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4563024] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:39:52 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563024/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563024/ "2019-12-03T12:06:50.532057+0000 mon.a (mon.0) 130 : cluster [WRN] Health check failed: 1 pool(s) have no replicas configured (POOL_NO_REDUNDANCY)" in cluster log [4562994] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:41:39 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562994/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562994/ "2019-12-03T03:45:35.742079+0000 mon.b (mon.1) 98 : cluster [WRN] Health check failed: 1 pool(s) have no replicas configured (POOL_NO_REDUNDANCY)" in cluster log [4562992] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/many.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:31:45 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562992/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562992/ Command failed (workunit test rados/test.sh) on mira072 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35b0b52153206fd6178afe584a2cd9c0ef2bcc05 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4563036] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:39:57 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563036/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563036/ "2019-12-03T14:23:38.174469+0000 mon.a (mon.0) 126 : cluster [WRN] Health check failed: 1 pool(s) have no replicas configured (POOL_NO_REDUNDANCY)" in cluster log [4563034] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync-many.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:22:54 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563034/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563034/ Command failed (workunit test rados/test.sh) on mira083 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35b0b52153206fd6178afe584a2cd9c0ef2bcc05 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4563022] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:29:18 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563022/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563022/ Command failed (workunit test rados/test.sh) on mira109 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35b0b52153206fd6178afe584a2cd9c0ef2bcc05 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4563030] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/rados_mon_workunits.yaml} ----------------------------------------------------------------- time: 00:29:12 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563030/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563030/ "2019-12-03T13:15:11.415759+0000 mon.b (mon.0) 162 : cluster [WRN] Health check failed: 1 pool(s) have no replicas configured (POOL_NO_REDUNDANCY)" in cluster log [4563028] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/one.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:28:43 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563028/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563028/ Command failed (workunit test rados/test.sh) on mira066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35b0b52153206fd6178afe584a2cd9c0ef2bcc05 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [4562998] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/one.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:31:07 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562998/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562998/ Command failed (workunit test rados/test.sh) on mira046 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=35b0b52153206fd6178afe584a2cd9c0ef2bcc05 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' Dead ================================================================= [4563041] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563041/ log: http://qa-proxy.ceph.com/teuthology/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563041/ Pass ================================================================= [4563019] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} time: 02:47:48 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563019/ [4563011] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} time: 00:59:24 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563011/ [4563012] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/many.yaml workloads/rados_mon_workunits.yaml} time: 00:44:28 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563012/ [4563013] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/one.yaml workloads/snaps-few-objects.yaml} time: 00:41:43 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563013/ [4563014] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync-many.yaml workloads/pool-create-delete.yaml} time: 02:31:58 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563014/ [4563015] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync.yaml workloads/rados_5925.yaml} time: 00:16:33 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563015/ [4563017] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/rados_mon_osdmap_prune.yaml} time: 01:13:56 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563017/ [4563032] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/pool-create-delete.yaml} time: 00:18:28 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563032/ [4563033] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/one.yaml workloads/rados_5925.yaml} time: 00:09:03 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563033/ [4563025] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/snaps-few-objects.yaml} time: 00:35:47 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563025/ [4563027] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/rados_5925.yaml} time: 00:09:40 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563027/ [4563026] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/force-sync-many.yaml workloads/pool-create-delete.yaml} time: 00:21:55 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563026/ [4563021] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_5925.yaml} time: 00:10:54 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563021/ [4563020] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync.yaml workloads/pool-create-delete.yaml} time: 00:23:54 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563020/ [4563023] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/one.yaml workloads/rados_mon_osdmap_prune.yaml} time: 01:29:49 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563023/ [4563029] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} time: 01:16:21 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563029/ [4563037] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/many.yaml workloads/snaps-few-objects.yaml} time: 00:49:10 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563037/ [4563009] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync-many.yaml workloads/rados_5925.yaml} time: 00:16:31 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563009/ [4563008] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/one.yaml workloads/pool-create-delete.yaml} time: 00:16:18 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563008/ [4563043] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/one.yaml workloads/snaps-few-objects.yaml} time: 00:37:19 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563043/ [4563003] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/one.yaml workloads/rados_5925.yaml} time: 00:21:25 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563003/ [4563002] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/many.yaml workloads/pool-create-delete.yaml} time: 02:34:24 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563002/ [4563001] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} time: 00:45:43 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563001/ [4563035] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/rados_mon_osdmap_prune.yaml} time: 00:58:48 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563035/ [4563007] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/snaps-few-objects.yaml} time: 00:42:29 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563007/ [4563005] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/rados_mon_osdmap_prune.yaml} time: 01:00:48 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563005/ [4563031] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/force-sync-many.yaml workloads/snaps-few-objects.yaml} time: 00:46:27 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563031/ [4562996] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/force-sync-many.yaml workloads/pool-create-delete.yaml} time: 00:19:52 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562996/ [4562997] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/many.yaml workloads/rados_5925.yaml} time: 00:15:20 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562997/ [4562995] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/snaps-few-objects.yaml} time: 00:34:31 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562995/ [4562993] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-avl.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/one.yaml workloads/rados_mon_osdmap_prune.yaml} time: 01:27:11 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562993/ [4562990] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync.yaml workloads/pool-create-delete.yaml} time: 00:16:05 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562990/ [4562991] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/force-sync-many.yaml workloads/rados_5925.yaml} time: 00:23:29 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562991/ [4563038] rados:monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_7.yaml} thrashers/one.yaml workloads/pool-create-delete.yaml} time: 00:29:13 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563038/ [4563039] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-comp.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync-many.yaml workloads/rados_5925.yaml} time: 00:10:22 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4563039/ [4562999] rados:monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_7.yaml} thrashers/sync-many.yaml workloads/rados_mon_osdmap_prune.yaml} time: 01:19:11 info: http://pulpito.ceph.com/gregf-2019-12-03_02:43:00-rados:monthrash-wip-elector-1202-2-distro-basic-mira/4562999/ 2019-12-03T16:08:20.904 INFO:teuthology.results:starting coverage generation