2020-06-20T11:14:08.994 INFO:root:teuthology version: 1.0.0-77b0d74 2020-06-20T11:14:08.995 INFO:teuthology.results:subset: '820/9999' 2020-06-20T11:14:08.996 INFO:teuthology.results:seed: '2477' 2020-06-20T15:45:44.067 INFO:root:teuthology version: 1.0.0-77b0d74 2020-06-20T15:45:44.088 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-06-21T03:46:08.341 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2020-06-21T03:46:08.790 INFO:teuthology.results:Sending results to akupczyk@redhat.com: Test Run: akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/ failed: 82 dead: 28 running: 0 waiting: 0 queued: 0 passed: 202 Fail ================================================================= [5159999] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} ----------------------------------------------------------------- time: 00:03:03 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5159999/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5159999/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=884f625971ad46b9bc4033fc6ada87b6 Command failed on smithi119 with status 5: 'sudo systemctl stop ceph- dad45aaa-b2e8-11ea-a06d-001a4aab830c@mon.smithi119' [5160009] rados/cephadm/smoke/{distro/centos_7 fixed-2 start} ----------------------------------------------------------------- time: 00:05:40 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160009/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160009/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a0bb16db10e34766b7dfadf63897db68 Command failed on smithi041 with status 5: 'sudo systemctl stop ceph-6cb5ae64-b2ea-11ea-a06d-001a4aab830c@mon.a' [5160011] rados/cephadm/smoke-roleless/{distro/centos_7 start} ----------------------------------------------------------------- time: 00:05:42 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160011/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160011/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b7073d80ac164aaaba7a832313fe6f36 Command failed on smithi003 with status 5: 'sudo systemctl stop ceph-95c74fe2-b2ea-11ea-a06d-001a4aab830c@mon.smithi003' [5160013] rados/singleton/{all/lost-unfound-delete msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 01:12:09 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160013/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160013/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=25708ed1018c49fc808ef384db86eb25 failed to become clean before timeout expired [5160023] rados/singleton/{all/lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 01:15:17 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160023/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160023/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=42db9b38d03748d885fae56d2039420f failed to become clean before timeout expired [5160027] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:08:55 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160027/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160027/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2fac9906ae6b402788be987b124c1875 Command failed on smithi059 with status 5: 'sudo systemctl stop ceph- bb04493e-b2ec-11ea-a06d-001a4aab830c@mon.a' [5160028] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:57 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160028/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160028/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=41badeea4d7d46edb845a7aa5b8d0cbe Command failed on smithi081 with status 5: 'sudo systemctl stop ceph-c5c5d06a-b2ea-11ea-a06d-001a4aab830c@mon.a' [5160032] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} ----------------------------------------------------------------- time: 00:03:51 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160032/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160032/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=df9b55a658d4436a9dda56a9cca943dc Command failed on smithi071 with status 5: 'sudo systemctl stop ceph-d7e44498-b2ea-11ea-a06d-001a4aab830c@mon.a' [5160037] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} ----------------------------------------------------------------- time: 00:03:49 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160037/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160037/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=803949fcb42b4caba68ba0802762b1df Command failed on smithi165 with status 5: 'sudo systemctl stop ceph-1fe56baa-b2eb-11ea-a06d-001a4aab830c@mon.smithi165' [5160040] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:48 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160040/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160040/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=732a203f851d4495883cfc890c9638f8 Command failed on smithi129 with status 5: 'sudo systemctl stop ceph-b9a1c478-b2eb-11ea-a06d-001a4aab830c@mon.a' [5160049] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} ----------------------------------------------------------------- time: 00:03:56 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160049/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160049/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c80723d0a48f475e9767f548fa472a99 Command failed on smithi038 with status 5: 'sudo systemctl stop ceph-124b1098-b2ec-11ea-a06d-001a4aab830c@mon.a' [5160053] rados/cephadm/smoke-roleless/{distro/centos_latest start} ----------------------------------------------------------------- time: 00:03:48 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160053/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160053/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9953811b142349ebacef97e9b0a58aaf Command failed on smithi061 with status 5: 'sudo systemctl stop ceph-233723c4-b2ec-11ea-a06d-001a4aab830c@mon.smithi061' [5160060] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:08:37 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160060/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160060/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7745dfd2ae624908a39147d1d7aa420e Command failed on smithi175 with status 5: 'sudo systemctl stop ceph- fb75160a-b2ed-11ea-a06d-001a4aab830c@mon.a' [5160061] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:11:58 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160061/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160061/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=dcb3319e08254c16ba9e3e1d01c18f54 Command failed on smithi005 with status 5: 'sudo systemctl stop ceph-1d41adee-b2ed-11ea-a06d-001a4aab830c@mon.a' [5160063] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:09:02 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160063/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160063/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1073a7c072d34f4a860482cf8330b9c0 Command failed (workunit test cephtool/test.sh) on smithi065 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c3fec47eab596755092f80f45932f20eea22357 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' [5160064] rados/cephadm/smoke/{distro/rhel_7 fixed-2 start} ----------------------------------------------------------------- time: 00:07:47 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160064/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160064/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e711b4ba314f40b595686493eb8bb9d9 Command failed on smithi165 with status 5: 'sudo systemctl stop ceph-003b8b52-b2ed-11ea-a06d-001a4aab830c@mon.a' [5160071] rados/cephadm/smoke-roleless/{distro/rhel_7 start} ----------------------------------------------------------------- time: 00:08:14 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160071/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160071/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0999148950484935b5bbd9c399501855 Command failed on smithi157 with status 5: 'sudo systemctl stop ceph-12e7e2fe-b2ee-11ea-a06d-001a4aab830c@mon.smithi157' [5160077] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:10:30 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160077/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160077/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=abd8b282a20546c294d78dcf1d4ea93f Command failed on smithi107 with status 5: 'sudo systemctl stop ceph- fdf51650-b2ed-11ea-a06d-001a4aab830c@mon.a' [5160082] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} ----------------------------------------------------------------- time: 00:06:45 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160082/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160082/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6496d578325f4d2e843057269ecd011d Command failed on smithi073 with status 5: 'sudo systemctl stop ceph-0a8003a8-b2ee-11ea-a06d-001a4aab830c@mon.a' [5160083] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} ----------------------------------------------------------------- time: 00:23:51 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160083/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160083/ Found coredumps on ubuntu@smithi025.front.sepia.ceph.com [5160086] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 06:33:26 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160086/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160086/ Command failed on smithi005 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [5160087] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:06:56 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160087/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160087/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ba05e6d0b9e64dc0b280fb21d70fe793 Command failed on smithi059 with status 5: 'sudo systemctl stop ceph-90db5c9a-b2ee-11ea-a06d-001a4aab830c@mon.smithi059' [5160092] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:05:53 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160092/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160092/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4db367025ca544c9bbbdaa7b1246788d Command failed on smithi105 with status 1: 'sudo yum -y install ceph- radosgw' [5160097] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} ----------------------------------------------------------------- time: 00:05:43 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160097/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160097/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5542aad62702453dba1341a1300e9b1a Command failed on smithi120 with status 5: 'sudo systemctl stop ceph-a8f063d4-b2ee-11ea-a06d-001a4aab830c@mon.a' [5160101] rados/cephadm/smoke-roleless/{distro/rhel_latest start} ----------------------------------------------------------------- time: 00:05:40 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160101/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160101/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6e2c2209fb714ce8a5b184fe5c634c67 Command failed on smithi065 with status 5: 'sudo systemctl stop ceph-f3cc5688-b2ee-11ea-a06d-001a4aab830c@mon.smithi065' [5160106] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:44 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160106/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160106/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=5343ee5c750149cfb9d88079fa13b29b Command failed on smithi110 with status 5: 'sudo systemctl stop ceph-8eaa0dee-b2ef-11ea-a06d-001a4aab830c@mon.a' [5160111] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} ----------------------------------------------------------------- time: 00:03:14 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160111/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160111/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=415139b2c95b4b058aff1a7a9adc4435 Command failed on smithi061 with status 5: 'sudo systemctl stop ceph-c982ab10-b2ef-11ea-a06d-001a4aab830c@mon.a' [5160114] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} ----------------------------------------------------------------- time: 00:03:09 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160114/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160114/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a5a15aee2252443f8bbf2e10be057ff2 Command failed on smithi094 with status 5: 'sudo systemctl stop ceph-c2cc8548-b2ef-11ea-a06d-001a4aab830c@mon.smithi094' [5160122] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:05:54 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160122/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160122/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2e704fb6a3034f6b8992b1167576c856 Command failed on smithi150 with status 1: 'sudo yum -y install ceph- radosgw' [5160124] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 01:13:36 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160124/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160124/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=bc9a1e64a62a4fd8ac4d5e0d859db695 Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-filestore 20 --debug- bluestore 20" ceph_test_objectstore --gtest_filter=-*/3 --gtest_catch_exceptions=0\'' [5160125] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:08:47 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160125/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160125/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f5984b2be00b4b89a8e51bc938da7c75 Command failed on smithi172 with status 5: 'sudo systemctl stop ceph-c12cba68-b2f0-11ea-a06d-001a4aab830c@mon.a' [5160129] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160129/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160129/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1f7aceccac47443abaceaf42cd08e714 Command failed on smithi140 with status 5: 'sudo systemctl stop ceph-f2b4d76e-b2f0-11ea-a06d-001a4aab830c@mon.a' [5160132] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} ----------------------------------------------------------------- time: 00:07:47 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160132/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160132/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=11190214d83c42b6858ae580704d968d Command failed on smithi154 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh' [5160133] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:08:53 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160133/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160133/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6828f0470c8a4e9bad07b3c695c13e9c Command failed (workunit test cephtool/test.sh) on smithi058 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c3fec47eab596755092f80f45932f20eea22357 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' [5160136] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:04:33 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160136/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160136/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c17a5ac9ad704b8ea7089a7594d69a45 Command failed on smithi103 with status 5: 'sudo systemctl stop ceph-5361b302-b2f1-11ea-a06d-001a4aab830c@mon.smithi103' [5160144] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:07:04 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160144/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160144/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b232cf7d44a345beae162567107ca105 Command failed on smithi061 with status 5: 'sudo systemctl stop ceph-6fd20ece-b2f1-11ea-a06d-001a4aab830c@mon.a' [5160145] rados/singleton/{all/radostool msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:30:53 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160145/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160145/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=790d84303b0d46aeb7ebfd0a2304b6e7 Command failed (workunit test rados/test_rados_tool.sh) on smithi094 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c3fec47eab596755092f80f45932f20eea22357 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_rados_tool.sh' [5160146] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} ----------------------------------------------------------------- time: 00:03:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160146/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160146/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=65ec51ac05f544ee958ffa38633eadfa Command failed on smithi068 with status 5: 'sudo systemctl stop ceph-8c93ce4e-b2f1-11ea-a06d-001a4aab830c@mon.a' [5160148] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} ----------------------------------------------------------------- time: 00:07:40 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160148/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160148/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2865ce21905747c4b1afe18552b924c7 Command failed on smithi110 with status 1: 'cd /home/ubuntu/cephtest/cos && chmod +x *.sh' [5160151] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} ----------------------------------------------------------------- time: 00:03:07 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160151/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160151/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e2ff8ce5a062421f8d7e47bca08b7561 Command failed on smithi062 with status 5: 'sudo systemctl stop ceph-386e12f6-b2f2-11ea-a06d-001a4aab830c@mon.smithi062' [5160154] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/few rados thrashers/careful thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:08:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160154/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160154/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=592db45bf6ae49d7b41be589f59ada08 Command failed on smithi117 with status 5: 'sudo systemctl stop ceph- efb4cf72-b2f2-11ea-a06d-001a4aab830c@mon.a' [5160156] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:46 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160156/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160156/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=91eb6d3030454e71a9db9e337fd18bc6 Command failed on smithi083 with status 5: 'sudo systemctl stop ceph-1ede731c-b2f2-11ea-a06d-001a4aab830c@mon.a' [5160168] rados/singleton/{all/rebuild-mondb msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:13:20 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160168/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160168/ "2020-06-20T12:36:46.525313+0000 mgr.x (mgr.10026) 1 : cluster [ERR] Unhandled exception from module 'devicehealth' while running on mgr.x: [errno 13] RADOS permission denied (error connecting to the cluster)" in cluster log [5160170] rados/cephadm/smoke/{distro/centos_7 fixed-2 start} ----------------------------------------------------------------- time: 00:05:48 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160170/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160170/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ab7713fb433c43e9911eef07eb8e6e3a Command failed on smithi037 with status 5: 'sudo systemctl stop ceph- ed95d646-b2f2-11ea-a06d-001a4aab830c@mon.a' [5160171] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 10:15:50 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160171/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160171/ Command failed on smithi055 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [5160174] rados/cephadm/smoke-roleless/{distro/centos_7 start} ----------------------------------------------------------------- time: 00:05:39 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160174/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160174/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c0e29011954c440f859ce43cae65943b Command failed on smithi136 with status 5: 'sudo systemctl stop ceph-65949092-b2f3-11ea-a06d-001a4aab830c@mon.smithi136' [5160175] rados/singleton/{all/recovery-preemption msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:19:47 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160175/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160175/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=45cea4c9da9e4e37b3259014706479f3 Command failed on smithi154 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'egrep \'"\'"\'(defer backfill|defer recovery)\'"\'"\' /var/log/ceph/ceph-osd.*.log\'' [5160177] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 09:49:09 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160177/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160177/ Command failed on smithi103 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [5160179] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:13:39 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160179/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160179/ "2020-06-20T12:42:32.324151+0000 mon.a (mon.0) 130 : cluster [WRN] Health check failed: Degraded data redundancy: 493/21644 objects degraded (2.278%), 6 pgs degraded (PG_DEGRADED)" in cluster log [5160180] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:27:22 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160180/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160180/ "2020-06-20T12:57:56.976247+0000 mon.b (mon.0) 1056 : cluster [WRN] Health check failed: 3 daemons have recently crashed (RECENT_CRASH)" in cluster log [5160187] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} ----------------------------------------------------------------- time: 00:03:55 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160187/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160187/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3046cdfee74348258163f87f19487882 Command failed on smithi134 with status 5: 'sudo systemctl stop ceph-41dff8e4-b2f3-11ea-a06d-001a4aab830c@mon.a' [5160189] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:08:15 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160189/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160189/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b9cef53d16f94c90baf9e8a163e3742a Command failed on smithi119 with status 5: 'sudo systemctl stop ceph-5aa8708a-b2f4-11ea-a06d-001a4aab830c@mon.a' [5160191] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} ----------------------------------------------------------------- time: 00:03:51 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160191/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160191/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=820010a4c0934a778c32cc7ba04f039d Command failed on smithi131 with status 5: 'sudo systemctl stop ceph-5de06592-b2f3-11ea-a06d-001a4aab830c@mon.smithi131' [5160194] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:32:29 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160194/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160194/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=7f7a70b1839844cd9125a77a6f1e5f40 Test failure: test_pool_update_metadata (tasks.mgr.dashboard.test_pool.PoolTest) [5160198] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:11:35 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160198/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160198/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=cab75055d7a949fcb30f3d50696c2f1d Command failed on smithi083 with status 5: 'sudo systemctl stop ceph-828d1f4c-b2f4-11ea-a06d-001a4aab830c@mon.a' [5160205] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:12:28 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160205/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160205/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1cf932860ace40688703059c0561032b Command failed (workunit test cephtool/test.sh) on smithi139 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c3fec47eab596755092f80f45932f20eea22357 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' [5160207] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} ----------------------------------------------------------------- time: 00:03:49 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160207/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160207/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ddffb9b5336d474bba4b90ba127c8df7 Command failed on smithi037 with status 5: 'sudo systemctl stop ceph-28ef3074-b2f4-11ea-a06d-001a4aab830c@mon.a' [5160211] rados/cephadm/smoke-roleless/{distro/centos_latest start} ----------------------------------------------------------------- time: 00:03:37 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160211/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160211/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e9a574ef0d754d5f88208fdb336072fd Command failed on smithi079 with status 5: 'sudo systemctl stop ceph-71989e50-b2f4-11ea-a06d-001a4aab830c@mon.smithi079' [5160214] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:10:41 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160214/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160214/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d28450791b624c8ea0fd95c60d75cdc8 Command failed on smithi095 with status 5: 'sudo systemctl stop ceph-37f81562-b2f5-11ea-a06d-001a4aab830c@mon.a' [5160219] rados/cephadm/smoke/{distro/rhel_7 fixed-2 start} ----------------------------------------------------------------- time: 00:07:55 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160219/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160219/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=0a7c73001dca48148371371f2f97e7e9 Command failed on smithi197 with status 5: 'sudo systemctl stop ceph-605e2f14-b2f5-11ea-a06d-001a4aab830c@mon.a' [5160223] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:08:53 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160223/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160223/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=89c3e36dd61f4b37a289c40ef7b4b794 Command failed on smithi058 with status 5: 'sudo systemctl stop ceph-5dfc2fae-b2f6-11ea-a06d-001a4aab830c@mon.a' [5160224] rados/cephadm/smoke-roleless/{distro/rhel_7 start} ----------------------------------------------------------------- time: 00:07:54 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160224/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160224/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f086c6fe8ac2408584e2095565ed9366 Command failed on smithi192 with status 5: 'sudo systemctl stop ceph-a3ee867a-b2f5-11ea-a06d-001a4aab830c@mon.smithi192' [5160237] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:52 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160237/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160237/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1646299fa1204da6b4f803e0ed875718 Command failed on smithi062 with status 5: 'sudo systemctl stop ceph-d2135ebc-b2f6-11ea-a06d-001a4aab830c@mon.a' [5160238] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:13:31 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160238/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160238/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op copy_from 50 --op write_excl 50 --op delete 50 --pool base' [5160239] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} ----------------------------------------------------------------- time: 00:06:32 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160239/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160239/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=175d0df6ab04405197d476ae15bac242 Command failed on smithi181 with status 5: 'sudo systemctl stop ceph-45dabefe-b2f6-11ea-a06d-001a4aab830c@mon.a' [5160242] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:06:49 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160242/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160242/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d7e7e81be4034f6eaaa581e0c6aebea3 Command failed on smithi179 with status 5: 'sudo systemctl stop ceph-a1c0b8d6-b2f6-11ea-a06d-001a4aab830c@mon.smithi179' [5160250] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} ----------------------------------------------------------------- time: 02:40:41 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160250/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160250/ Command failed on smithi042 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json' [5160253] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:08:44 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160253/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160253/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=03694dafc9a84e3bae14a79cff927c2d Command failed on smithi197 with status 5: 'sudo systemctl stop ceph- ad6a1e24-b2f7-11ea-a06d-001a4aab830c@mon.a' [5160255] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160255/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160255/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=da6c80129235453eb4b2408f2cf3a292 Command failed on smithi148 with status 5: 'sudo systemctl stop ceph-0a64c57a-b30c-11ea-a06d-001a4aab830c@mon.a' [5160256] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} ----------------------------------------------------------------- time: 00:05:36 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160256/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160256/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=c739a93301344b50914cd24e0a9e768d Command failed on smithi061 with status 5: 'sudo systemctl stop ceph-a9f1f604-b30b-11ea-a06d-001a4aab830c@mon.a' [5160261] rados/cephadm/smoke-roleless/{distro/rhel_latest start} ----------------------------------------------------------------- time: 00:05:31 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160261/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160261/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=42886c0660424a6282286fbcdb54c5a5 Command failed on smithi188 with status 5: 'sudo systemctl stop ceph-e6ac05a8-b30b-11ea-a06d-001a4aab830c@mon.smithi188' [5160262] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:35:30 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160262/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160262/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b5900cd6c531437fb86f08e7ac8688a8 Test failure: test_pool_update_metadata (tasks.mgr.dashboard.test_pool.PoolTest) [5160268] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} ----------------------------------------------------------------- time: 00:03:12 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160268/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160268/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=dfdc29fdc97545de9a6e7fc296d0bd02 Command failed on smithi082 with status 5: 'sudo systemctl stop ceph-19193b78-b30c-11ea-a06d-001a4aab830c@mon.a' [5160273] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} ----------------------------------------------------------------- time: 00:03:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160273/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160273/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=719bed447f744079854c3c76dda85276 Command failed on smithi014 with status 5: 'sudo systemctl stop ceph-2fab5a6a-b30c-11ea-a06d-001a4aab830c@mon.smithi014' [5160274] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:12:56 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160274/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160274/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=415da49807364ab7ab766ba70a1ca6af Command failed (workunit test cephtool/test.sh) on smithi072 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c3fec47eab596755092f80f45932f20eea22357 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' [5160276] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} ----------------------------------------------------------------- time: 00:12:25 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160276/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160276/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=803d6207c57a4c1caaadfe6d0901ca7c Command failed (workunit test cephadm/test_cephadm.sh) on smithi037 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c3fec47eab596755092f80f45932f20eea22357 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5160280] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:50 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160280/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160280/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4c28d0ec43ef46a99cf8e09404466b1e Command failed on smithi184 with status 5: 'sudo systemctl stop ceph-2742c164-b30d-11ea-a06d-001a4aab830c@mon.a' [5160285] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} ----------------------------------------------------------------- time: 00:05:07 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160285/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160285/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=dcc5199cf27a439f823236c69c705ef4 Command failed on smithi188 with status 5: 'sudo systemctl stop ceph- ddb8a99a-b30d-11ea-a06d-001a4aab830c@mon.a' [5160289] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:08:58 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160289/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160289/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b6b7f87bd5084e9c9e2cd0740d0d3646 Command failed on smithi176 with status 5: 'sudo systemctl stop ceph-d992dc5e-b30e-11ea-a06d-001a4aab830c@mon.a' [5160290] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:04:29 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160290/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160290/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=42a8d9a1cbe348758fadd03d63012165 Command failed on smithi033 with status 5: 'sudo systemctl stop ceph- fee1820e-b30d-11ea-a06d-001a4aab830c@mon.smithi033' [5160296] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:42 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160296/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160296/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a2ce57561a654023b3b245ede95bf133 Command failed on smithi138 with status 5: 'sudo systemctl stop ceph-10b9854e-b30e-11ea-a06d-001a4aab830c@mon.a' [5160304] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} ----------------------------------------------------------------- time: 00:03:02 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160304/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160304/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=b130c1b2b6454e0daaa96e1ab812d348 Command failed on smithi041 with status 5: 'sudo systemctl stop ceph-8aec7e56-b260-11ea-a06d-001a4aab830c@mon.a' Dead ================================================================= [5160005] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} ----------------------------------------------------------------- time: 11:48:54 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160005/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160005/ psutil.NoSuchProcess process no longer exists (pid=4515) [5160017] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_7} fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160017/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160017/ [5160026] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160026/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160026/ [5160043] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160043/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160043/ [5160045] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160045/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160045/ [5160058] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160058/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160058/ [5160068] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160068/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160068/ [5160091] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160091/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160091/ [5160116] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160116/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160116/ [5160126] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160126/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160126/ [5160131] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160131/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160131/ [5160147] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160147/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160147/ [5160155] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160155/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160155/ [5160162] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 11:50:57 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160162/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160162/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=fdca112fd01c421293124a9f781ae391 psutil.NoSuchProcess process no longer exists (pid=7125) [5160178] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_7} fixed-2} ----------------------------------------------------------------- time: 11:48:21 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160178/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160178/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=17bad576e40e42998d74baf9eaffa808 psutil.NoSuchProcess process no longer exists (pid=15224) [5160188] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160188/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160188/ [5160196] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160196/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160196/ [5160208] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160208/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160208/ [5160212] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160212/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160212/ [5160218] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160218/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160218/ [5160220] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160220/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160220/ [5160233] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160233/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160233/ [5160258] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160258/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160258/ [5160275] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160275/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160275/ [5160281] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160281/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160281/ [5160282] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160282/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160282/ [5160294] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160294/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160294/ [5160303] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160303/ log: http://qa-proxy.ceph.com/teuthology/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160303/ Pass ================================================================= [5159998] rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:33:07 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5159998/ [5160000] rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:03 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160000/ [5160001] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:46 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160001/ [5160002] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:19:19 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160002/ [5160003] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:54 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160003/ [5160004] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:11:03 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160004/ [5160006] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:23:57 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160006/ [5160007] rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:07:08 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160007/ [5160008] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} time: 00:34:19 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160008/ [5160010] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{ubuntu_latest}} time: 00:09:31 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160010/ [5160012] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:16:55 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160012/ [5160014] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:11:15 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160014/ [5160015] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160015/ [5160016] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:11:37 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160016/ [5160018] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:33 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160018/ [5160019] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 00:53:40 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160019/ [5160020] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:07:06 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160020/ [5160021] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:08:29 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160021/ [5160022] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/prometheus} time: 00:10:24 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160022/ [5160024] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:22:48 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160024/ [5160025] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 00:52:19 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160025/ [5160029] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:08:53 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160029/ [5160030] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_8}} time: 00:09:16 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160030/ [5160031] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:13:08 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160031/ [5160033] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:34 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160033/ [5160034] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:31 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160034/ [5160035] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:20:46 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160035/ [5160036] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:17:55 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160036/ [5160038] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:14:08 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160038/ [5160039] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:11:37 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160039/ [5160041] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:19:34 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160041/ [5160042] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:30:43 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160042/ [5160044] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:06 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160044/ [5160046] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 01:08:35 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160046/ [5160047] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{rhel_8}} time: 00:18:45 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160047/ [5160048] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:11:44 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160048/ [5160050] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:47 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160050/ [5160051] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:09:02 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160051/ [5160052] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:31:40 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160052/ [5160054] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} time: 00:58:03 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160054/ [5160055] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:16:24 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160055/ [5160056] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:18:32 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160056/ [5160057] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} time: 00:18:32 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160057/ [5160059] rados/singleton/{all/mon-auth-caps msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:01 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160059/ [5160062] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:07:57 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160062/ [5160065] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:21:13 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160065/ [5160066] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:24 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160066/ [5160067] rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:10:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160067/ [5160069] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{rhel_8}} time: 00:25:46 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160069/ [5160070] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:09:43 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160070/ [5160072] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 02:23:24 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160072/ [5160073] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:04:47 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160073/ [5160074] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:36 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160074/ [5160075] rados/singleton/{all/mon-config-keys msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:41 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160075/ [5160076] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:30:21 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160076/ [5160078] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:13:25 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160078/ [5160079] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:15:43 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160079/ [5160080] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:21:12 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160080/ [5160081] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/crash} time: 00:14:07 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160081/ [5160084] rados/singleton/{all/mon-config msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:12:44 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160084/ [5160085] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{centos_8}} time: 00:18:24 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160085/ [5160088] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache} time: 00:13:06 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160088/ [5160089] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:00:09 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160089/ [5160090] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:26:37 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160090/ [5160093] rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:07:38 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160093/ [5160094] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:09:52 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160094/ [5160095] rados/singleton/{all/osd-backfill msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:18:38 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160095/ [5160096] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:27:32 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160096/ [5160098] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/dedup_tier} time: 00:11:17 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160098/ [5160099] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:22:22 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160099/ [5160100] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:12:29 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160100/ [5160102] rados/singleton/{all/osd-recovery-incomplete msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:20:38 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160102/ [5160103] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{centos_8}} time: 00:08:19 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160103/ [5160104] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:31:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160104/ [5160105] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:25 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160105/ [5160107] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:59 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160107/ [5160108] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:27:24 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160108/ [5160109] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:28:08 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160109/ [5160110] rados/singleton/{all/osd-recovery msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:12:57 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160110/ [5160112] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:46 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160112/ [5160113] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:09:52 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160113/ [5160115] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:15 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160115/ [5160117] rados/singleton/{all/peer msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:12:04 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160117/ [5160118] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:14:06 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160118/ [5160119] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:20:24 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160119/ [5160120] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{ubuntu_latest}} time: 00:28:06 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160120/ [5160121] rados/multimon/{clusters/6 msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:11:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160121/ [5160123] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/dashboard} time: 00:55:20 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160123/ [5160127] rados/singleton/{all/pg-autoscaler msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:10:58 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160127/ [5160128] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:16:14 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160128/ [5160130] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:58:47 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160130/ [5160134] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:36:51 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160134/ [5160135] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:35 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160135/ [5160137] rados/singleton/{all/pg-removal-interruption msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:07:50 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160137/ [5160138] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:04:35 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160138/ [5160139] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:15:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160139/ [5160140] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} time: 00:11:20 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160140/ [5160141] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{rhel_8}} time: 00:12:52 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160141/ [5160142] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/insights} time: 00:11:13 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160142/ [5160143] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} time: 01:19:35 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160143/ [5160149] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:11:48 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160149/ [5160150] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:07:46 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160150/ [5160152] rados/singleton/{all/random-eio msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:27:42 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160152/ [5160153] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:19:32 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160153/ [5160157] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:54:55 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160157/ [5160158] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:08:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160158/ [5160159] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:13:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160159/ [5160160] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{rhel_8}} time: 00:18:23 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160160/ [5160161] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:10:18 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160161/ [5160163] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:37 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160163/ [5160164] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:32:25 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160164/ [5160165] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:36 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160165/ [5160166] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:11:33 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160166/ [5160167] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:18:16 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160167/ [5160169] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:13:35 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160169/ [5160172] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} time: 01:17:12 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160172/ [5160173] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:24:43 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160173/ [5160176] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:15:45 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160176/ [5160181] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:15:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160181/ [5160182] rados/singleton/{all/resolve_stuck_peering msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:13:07 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160182/ [5160183] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} time: 00:08:52 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160183/ [5160184] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:12:37 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160184/ [5160185] rados/multimon/{clusters/21 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:08:09 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160185/ [5160186] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunk-promote-flush} time: 00:10:51 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160186/ [5160190] rados/singleton/{all/test-crash msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:13:34 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160190/ [5160192] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:09 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160192/ [5160193] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:28:14 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160193/ [5160195] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:12:09 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160195/ [5160197] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{ubuntu_latest}} time: 00:08:38 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160197/ [5160199] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:18:23 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160199/ [5160200] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:34 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160200/ [5160201] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} time: 00:19:15 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160201/ [5160202] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/progress} time: 00:15:12 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160202/ [5160203] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:17 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160203/ [5160204] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} time: 00:15:30 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160204/ [5160206] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:35:07 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160206/ [5160209] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:23:12 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160209/ [5160210] rados/singleton/{all/thrash-backfill-full msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 01:31:28 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160210/ [5160213] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{rhel_8}} time: 00:12:30 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160213/ [5160215] rados/multimon/{clusters/3 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:13:19 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160215/ [5160216] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:49 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160216/ [5160217] rados/singleton/{all/thrash-eio msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:32:55 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160217/ [5160221] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:25:55 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160221/ [5160222] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:31 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160222/ [5160225] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/sync workloads/pool-create-delete} time: 00:20:58 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160225/ [5160226] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:23:26 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160226/ [5160227] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:23:54 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160227/ [5160228] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard} time: 00:53:39 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160228/ [5160229] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:07:59 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160229/ [5160230] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:04:56 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160230/ [5160231] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:10:27 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160231/ [5160232] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:16:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160232/ [5160234] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind} time: 00:27:35 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160234/ [5160235] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{rhel_8}} time: 00:10:53 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160235/ [5160236] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:07 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160236/ [5160240] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:31:20 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160240/ [5160241] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:09 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160241/ [5160243] rados/singleton/{all/watch-notify-same-primary msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:11:05 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160243/ [5160244] rados/multimon/{clusters/6 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:07:36 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160244/ [5160245] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:09:50 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160245/ [5160246] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:10:45 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160246/ [5160247] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:21:40 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160247/ [5160248] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:15 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160248/ [5160249] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:54 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160249/ [5160251] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_8}} time: 00:07:51 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160251/ [5160252] rados/singleton/{all/admin-socket msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:07:42 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160252/ [5160254] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_5925} time: 00:14:11 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160254/ [5160257] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:14:13 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160257/ [5160259] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/workunits} time: 00:12:15 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160259/ [5160260] rados/singleton/{all/deduptool msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:11:59 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160260/ [5160263] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:18:03 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160263/ [5160264] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:17:24 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160264/ [5160265] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:40 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160265/ [5160266] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep} time: 00:20:45 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160266/ [5160267] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:24:46 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160267/ [5160269] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:30 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160269/ [5160270] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{ubuntu_latest}} time: 00:08:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160270/ [5160271] rados/singleton/{all/divergent_priors msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:13:26 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160271/ [5160272] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:57 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160272/ [5160277] rados/multimon/{clusters/9 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:11:10 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160277/ [5160278] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:51 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160278/ [5160279] rados/singleton/{all/divergent_priors2 msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:12:49 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160279/ [5160283] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:11:38 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160283/ [5160284] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:16:27 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160284/ [5160286] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_api_tests} time: 00:27:41 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160286/ [5160287] rados/singleton/{all/dump-stuck msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:09:21 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160287/ [5160288] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{centos_8}} time: 00:09:35 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160288/ [5160291] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/crash} time: 00:13:41 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160291/ [5160292] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:24:03 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160292/ [5160293] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:23:16 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160293/ [5160295] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind} time: 03:10:00 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160295/ [5160297] rados/singleton/{all/ec-lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:33:54 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160297/ [5160298] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:54:04 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160298/ [5160299] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:25:13 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160299/ [5160300] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:04:31 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160300/ [5160301] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:10:38 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160301/ [5160302] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/on msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:16:43 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160302/ [5160305] rados/singleton/{all/erasure-code-nonregression msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:07:05 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160305/ [5160306] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{centos_8}} time: 00:08:49 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160306/ [5160307] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:19:23 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160307/ [5160308] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:35:44 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160308/ [5160309] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:12 info: http://pulpito.ceph.com/akupczyk-2020-06-18_09:02:54-rados-wip-aclamk-memtracking-segfault-bluestore-distro-basic-smithi/5160309/