2021-06-02T21:53:41.739 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-02T21:53:41.741 INFO:teuthology.results:subset: '111/120000' 2021-06-02T21:53:41.741 INFO:teuthology.results:seed: '8223' 2021-06-03T15:00:23.502 INFO:root:teuthology version: 1.1.0-f359b10d 2021-06-03T15:00:23.539 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-06-04T02:07:20.509 INFO:teuthology.results:Tests finished! gathering results... 2021-06-04T02:07:55.135 INFO:scrape:Found 297 jobs 2021-06-04T02:08:11.728 INFO:scrape:Found 9 distinct failure reasons 2021-06-04T02:08:11.729 INFO:scrape:Failure: No module named 'tasks.ceph' 2021-06-04T02:08:11.730 INFO:scrape:3 jobs: ['6146885', '6146897', '6146898'] 2021-06-04T02:08:11.730 INFO:scrape:suites intersection: ['rados'] 2021-06-04T02:08:11.731 INFO:scrape:suites union: ['clusters/{fixed-2', 'fast/fast', 'msgr-failures/few', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/singleton/{all/osd-recovery', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_18.04}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/rados_workunit_loadgen_mix}', 'thrashers/default', 'thrashosds-health', 'workloads/ec-rados-plugin=jerasure-k=3-m=1}'] 2021-06-04T02:08:11.731 INFO:scrape: 2021-06-04T02:08:11.732 INFO:scrape:Failure: Command failed on smithi007 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" 2021-06-04T02:08:11.732 INFO:scrape:9 jobs: ['6146618', '6146742', '6146657', '6146609', '6147142', '6147098', '6146771', '6146959', '6146887'] 2021-06-04T02:08:11.733 INFO:scrape:suites intersection: [] 2021-06-04T02:08:11.733 INFO:scrape:suites union: ['distro/ubuntu_20.04', 'fixed-2', 'mode/root', 'msgr/async-v1only', 'rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable', 'rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing', 'start', 'task/test_adoption}', 'task/test_cephadm_repos}', 'task/test_cephadm}', 'task/test_orch_cli}', 'tasks/rados_python}'] 2021-06-04T02:08:11.734 INFO:scrape: 2021-06-04T02:08:11.734 INFO:scrape:Failure: "2021-06-03T14:42:52.509104+0000 mgr.z (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log 2021-06-04T02:08:11.734 INFO:scrape:25 jobs: ['6147185', '6146803', '6146689', '6146619', '6146610', '6146719', '6146752', '6146859', '6146621', '6147101', '6146653', '6147199', '6146661', '6146968', '6147203', '6147196', '6146746', '6146645', '6147221', '6146765', '6146640', '6146679', '6146923', '6146813', '6146709'] 2021-06-04T02:08:11.735 INFO:scrape:suites intersection: [] 2021-06-04T02:08:11.736 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/off', 'd-balancer/upmap', 'debug/mgr', 'fast/fast', 'fast/normal', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/dashboard/{clusters/{2-node-mgr}', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/singleton-bluestore/{all/cephtool', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'tasks/dashboard}', 'tasks/failover}', 'tasks/insights}', 'tasks/rados_cls_all}', 'tasks/rados_python}', 'tasks/rados_striper}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'workloads/cache-agent-small}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/cache-pool-snaps}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects-fast-read-overwrites}', 'workloads/ec-small-objects-many-deletes}', 'workloads/ec-small-objects-overwrites}', 'workloads/ec-snaps-few-objects-overwrites}', 'workloads/rados_api_tests}', 'workloads/small-objects}', 'workloads/write_fadvise_dontneed}'] 2021-06-04T02:08:11.736 INFO:scrape: 2021-06-04T02:08:11.737 INFO:scrape:Failure: list index out of range 2021-06-04T02:08:11.737 INFO:scrape:8 jobs: ['6147223', '6146807', '6147177', '6146643', '6146727', '6147068', '6146956', '6146839'] 2021-06-04T02:08:11.738 INFO:scrape:suites intersection: [] 2021-06-04T02:08:11.738 INFO:scrape:suites union: ['rados/cephadm/dashboard/0-distro/centos_8.2_kubic_stable', 'rados/cephadm/thrash/0-distro/centos_8.2_kubic_stable', 'rados/cephadm/thrash/0-distro/ubuntu_20.04_kubic_stable', 'rados/cephadm/thrash/0-distro/ubuntu_20.04_kubic_testing'] 2021-06-04T02:08:11.739 INFO:scrape: 2021-06-04T02:08:11.739 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=mimic 2021-06-04T02:08:11.739 INFO:scrape:2 jobs: ['6146787', '6147159'] 2021-06-04T02:08:11.740 INFO:scrape:suites intersection: ['2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}'] 2021-06-04T02:08:11.740 INFO:scrape:suites union: ['1-install/mimic', '1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'rados/upgrade/mimic-x-singleton/{0-cluster/{openstack', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}'] 2021-06-04T02:08:11.741 INFO:scrape: 2021-06-04T02:08:11.741 INFO:scrape:Dead: b'2021-06-03T23:48:08.503 DEBUG:teuthology.exit:Finished running handlers' 2021-06-04T02:08:11.742 INFO:scrape:10 jobs: ['6146871', '6146763', '6147011', '6146900', '6146902', '6146620', '6146953', '6146600', '6146683', '6147130'] 2021-06-04T02:08:11.742 INFO:scrape:suites intersection: [] 2021-06-04T02:08:11.743 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'fixed-2}', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp', 'openstack', 'rados/cephadm/upgrade/{1-start-distro/1-start-centos_8', 'rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'rados/perf/{ceph', 'settings/optimized', 'ubuntu_latest', 'workloads/cosbench_64K_read_write}', 'workloads/cosbench_64K_write}'] 2021-06-04T02:08:11.743 INFO:scrape: 2021-06-04T02:08:11.744 INFO:scrape:Failure: Command failed on smithi143 with status 100: 'sudo apt-get clean' 2021-06-04T02:08:11.744 INFO:scrape:1 jobs: ['6146773'] 2021-06-04T02:08:11.745 INFO:scrape:suites: ['objectstore/bluestore-low-osd-mem-target', 'openstack', 'rados/perf/{ceph', 'settings/optimized', 'ubuntu_latest', 'workloads/radosbench_4M_write}'] 2021-06-04T02:08:11.745 INFO:scrape: 2021-06-04T02:08:11.746 INFO:scrape:Failure: Command crashed: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5f94e4f0802cec4b7233d501c170e3b1496d1a07 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/test_mon_config_key.py' 2021-06-04T02:08:11.746 INFO:scrape:2 jobs: ['6146835', '6146950'] 2021-06-04T02:08:11.747 INFO:scrape:suites intersection: ['msgr-failures/many', 'msgr/async-v1only', 'rados'] 2021-06-04T02:08:11.747 INFO:scrape:suites union: ['msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'rados', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/pg-autoscaler-progress-off', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}}'] 2021-06-04T02:08:11.747 INFO:scrape: 2021-06-04T02:08:11.748 INFO:scrape:Failure: SSH connection to smithi143 was lost: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' 2021-06-04T02:08:11.748 INFO:scrape:1 jobs: ['6146779'] 2021-06-04T02:08:11.749 INFO:scrape:suites: ['rados/objectstore/{backends/alloc-hint', 'supported-random-distro$/{ubuntu_latest}}'] 2021-06-04T02:08:11.749 INFO:scrape: 2021-06-04T02:08:11.761 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/ failed: 50 dead: 11 running: 0 waiting: 0 queued: 0 passed: 236 Fail ================================================================= [6146609] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_orch_cli} ----------------------------------------------------------------- time: 00:03:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146609/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146609/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c7564ec22254224b84bf68939bc47fa Command failed on smithi192 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" [6146610] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-agent-small} ----------------------------------------------------------------- time: 00:09:50 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146610/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146610/ "2021-06-02T22:20:55.506390+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146618] rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable distro/ubuntu_20.04 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:03:46 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146618/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146618/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f7a5c23a3ebd4d4b9f35bad770781667 Command failed on smithi007 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" [6146619] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:19:56 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146619/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146619/ "2021-06-02T22:22:51.027677+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146621] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} ----------------------------------------------------------------- time: 00:24:47 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146621/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146621/ "2021-06-02T22:23:48.187660+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146640] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:21:03 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146640/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146640/ "2021-06-02T22:33:49.605072+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146643] rados/cephadm/thrash/0-distro/ubuntu_20.04_kubic_stable ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146643/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146643/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41498fad88ad45d39df7ecd21fdf5752 list index out of range [6146645] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/failover} ----------------------------------------------------------------- time: 00:11:43 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146645/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146645/ "2021-06-02T22:35:18.665077+0000 mgr.y (mgr.4135) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146653] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 01:04:05 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146653/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146653/ "2021-06-02T22:39:49.573931+0000 mgr.z (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146657] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_adoption} ----------------------------------------------------------------- time: 00:03:31 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146657/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146657/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bfdd30a716364322a80c729b5d85bc4f Command failed on smithi170 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" [6146661] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:12:55 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146661/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146661/ "2021-06-02T22:42:37.893760+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146679] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:21:23 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146679/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146679/ "2021-06-02T22:51:26.554160+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146689] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:19:56 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146689/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146689/ "2021-06-02T22:57:10.635346+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146709] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} ----------------------------------------------------------------- time: 00:12:56 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146709/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146709/ "2021-06-03T03:45:01.056933+0000 mgr.y (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146719] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 01:03:17 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146719/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146719/ "2021-06-03T03:53:26.347734+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146727] rados/cephadm/thrash/0-distro/ubuntu_20.04_kubic_testing ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146727/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146727/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a94390182994e7490802e353bcae1ad list index out of range [6146742] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:03:34 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146742/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146742/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41d70d05dfb0466e8d277e57fa3d1210 Command failed on smithi187 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" [6146746] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:10:30 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146746/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146746/ "2021-06-03T10:23:21.157005+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146752] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:21:12 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146752/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146752/ "2021-06-03T10:23:46.058179+0000 mgr.y (mgr.4118) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146765] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:23:54 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146765/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146765/ "2021-06-03T10:29:12.631036+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146771] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_orch_cli} ----------------------------------------------------------------- time: 00:03:39 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146771/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146771/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b305e3e714aa408e8c8292af1af08a81 Command failed on smithi078 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" [6146773] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146773/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146773/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad76b58f5123438b8f676c0993021892 Command failed on smithi143 with status 100: 'sudo apt-get clean' [6146787] rados/upgrade/mimic-x-singleton/{0-cluster/{openstack start} 1-install/mimic 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 00:04:09 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146787/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146787/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c326ad254c3b45c78a338eaa83ca71de Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref= mimic [6146803] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:23:02 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146803/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146803/ "2021-06-03T10:44:30.583647+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146807] rados/cephadm/dashboard/0-distro/centos_8.2_kubic_stable ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146807/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146807/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f42c877d38b741cba697962fa1fff4b4 list index out of range [6146813] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} ----------------------------------------------------------------- time: 00:07:45 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146813/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146813/ "2021-06-03T10:47:42.690435+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146835] rados/singleton/{all/mon-config-keys msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 03:01:48 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146835/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146835/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59f2a1a43c834151ac7c7fbda7c70714 Command crashed: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5f94e4f0802cec4b7233d501c170e3b1496d1a07 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/mon/test_mon_config_key.py' [6146839] rados/cephadm/thrash/0-distro/centos_8.2_kubic_stable ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146839/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146839/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e588904b13544aa6b12c964707961f7e list index out of range [6146859] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:10:41 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146859/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146859/ "2021-06-03T11:59:09.992279+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146885] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} ----------------------------------------------------------------- time: 00:05:25 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146885/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146885/ sentry: https://sentry.ceph.com/organizations/ceph/?query=88159126d4544af88b4b2a255e89ceff No module named 'tasks.ceph' [6146887] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_cephadm} ----------------------------------------------------------------- time: 00:03:38 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146887/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146887/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a6c96d1b4f24cdeb19610c9fa3c1c9e Command failed on smithi075 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" [6146897] rados/singleton/{all/osd-recovery msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:05:20 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146897/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146897/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5931c43a9286427db7c0ccf1bcfcf806 No module named 'tasks' [6146898] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} ----------------------------------------------------------------- time: 00:16:34 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146898/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146898/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f02e7a3099ad47a8844dcc6a7e0462ad No module named 'tasks' [6146923] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 01:04:03 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146923/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146923/ "2021-06-03T12:17:34.244098+0000 mgr.z (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6146950] rados/singleton/{all/pg-autoscaler-progress-off msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:27:35 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146950/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146950/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a72437a630f43e3a0ed431223402fbf Command failed (workunit test mon/pg_autoscaler.sh) on smithi089 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5f94e4f0802cec4b7233d501c170e3b1496d1a07 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pg_autoscaler.sh' [6146956] rados/cephadm/thrash/0-distro/ubuntu_20.04_kubic_stable ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146956/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146956/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e240286814e54862908a928a9917028c list index out of range [6146959] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:03:32 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146959/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146959/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc6620e53c154a7ea962d14b577178ca Command failed on smithi125 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" [6146968] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects} ----------------------------------------------------------------- time: 00:18:19 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146968/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146968/ "2021-06-03T12:38:39.804890+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6147068] rados/cephadm/thrash/0-distro/ubuntu_20.04_kubic_testing ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147068/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147068/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b48d1195da194db5aaf4be368a077d85 list index out of range [6147098] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_stable task/test_adoption} ----------------------------------------------------------------- time: 00:03:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147098/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147098/ sentry: https://sentry.ceph.com/organizations/ceph/?query=de536623e8974a0b9089457c6653d064 Command failed on smithi064 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" [6147101] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:13:10 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147101/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147101/ "2021-06-03T13:52:18.096339+0000 mgr.x (mgr.4115) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6147142] rados/cephadm/workunits/{0-distro/ubuntu_20.04_kubic_testing task/test_cephadm} ----------------------------------------------------------------- time: 00:03:35 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147142/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147142/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d1fc25b63d7410a960e6659ab5b4782 Command failed on smithi131 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup'" [6147159] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 00:04:13 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147159/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147159/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9fda42ff50d249b7bb6045a971e13f3f Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref= nautilus [6147177] rados/cephadm/dashboard/0-distro/centos_8.2_kubic_stable ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147177/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147177/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a2aae5a32b414bd785824a9eed71c04c list index out of range [6147185] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/insights} ----------------------------------------------------------------- time: 00:11:53 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147185/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147185/ "2021-06-03T14:42:52.509104+0000 mgr.z (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6147196] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:20:50 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147196/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147196/ "2021-06-03T14:53:48.037251+0000 mgr.y (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6147199] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 01:03:35 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147199/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147199/ "2021-06-03T14:54:44.740143+0000 mgr.z (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6147203] rados/singleton-bluestore/{all/cephtool msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:28:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147203/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147203/ "2021-06-03T14:55:17.731877+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6147221] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} ----------------------------------------------------------------- time: 00:22:28 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147221/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147221/ "2021-06-03T15:15:33.304442+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: rook" in cluster log [6147223] rados/cephadm/thrash/0-distro/centos_8.2_kubic_stable ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147223/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a457261f251340b9b194cdf51a508f61 list index out of range Dead ================================================================= [6146600] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146600/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146600/ hit max job timeout [6146620] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146620/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146620/ hit max job timeout [6146683] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146683/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146683/ hit max job timeout [6146763] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146763/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146763/ hit max job timeout [6146779] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146779/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146779/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c0e227ea9154d6a89f175a526964ccb SSH connection to smithi143 was lost: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic' [6146871] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146871/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146871/ hit max job timeout [6146900] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146900/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146900/ hit max job timeout [6146902] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146902/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146902/ hit max job timeout [6146953] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146953/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146953/ hit max job timeout [6147011] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147011/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147011/ hit max job timeout [6147130] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8 2-repo_digest/repo_digest 3-start-upgrade 4-wait fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147130/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147130/ hit max job timeout Pass ================================================================= [6146593] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04} thrashers/sync-many workloads/rados_mon_osdmap_prune} time: 00:37:57 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146593/ [6146594] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:18:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146594/ [6146595] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:31 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146595/ [6146596] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} tasks/mon_clock_no_skews} time: 00:06:48 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146596/ [6146597] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:20 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146597/ [6146598] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:08 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146598/ [6146599] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} time: 00:15:29 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146599/ [6146601] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:20:08 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146601/ [6146602] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:11:23 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146602/ [6146603] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:24:25 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146603/ [6146604] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable task/test_cephadm_repos} time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146604/ [6146605] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04}} time: 00:19:18 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146605/ [6146606] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{centos_8}} time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146606/ [6146607] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:23 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146607/ [6146608] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:21:23 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146608/ [6146611] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:15:05 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146611/ [6146612] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/crash} time: 00:20:49 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146612/ [6146613] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146613/ [6146614] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:20 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146614/ [6146615] rados/singleton-bluestore/{all/cephtool msgr-failures/none msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:27:43 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146615/ [6146616] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:18:13 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146616/ [6146617] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:09:04 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146617/ [6146622] rados/singleton/{all/admin-socket msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:17:05 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146622/ [6146623] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04} tasks/rados_api_tests} time: 00:21:40 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146623/ [6146624] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{centos_8}} time: 00:23:49 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146624/ [6146625] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04} thrashers/sync workloads/rados_mon_workunits} time: 00:24:45 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146625/ [6146626] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:21:18 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146626/ [6146627] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 02:59:02 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146627/ [6146628] rados/multimon/{clusters/3 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:14 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146628/ [6146629] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:53 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146629/ [6146630] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146630/ [6146631] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} time: 00:38:37 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146631/ [6146632] rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 start} time: 00:56:45 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146632/ [6146633] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:07 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146633/ [6146634] rados/singleton/{all/deduptool msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04}} time: 00:07:20 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146634/ [6146635] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:26:40 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146635/ [6146636] rados/cephadm/smoke-roleless/{distro/rhel_8.3_kubic_stable start} time: 00:37:09 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146636/ [6146638] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:12 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146638/ [6146641] rados/singleton/{all/divergent_priors msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:09 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146641/ [6146647] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{ubuntu_latest}} time: 00:17:01 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146647/ [6146649] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:20:28 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146649/ [6146651] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:55 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146651/ [6146655] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:23:12 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146655/ [6146659] rados/singleton/{all/divergent_priors2 msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146659/ [6146663] rados/cephadm/with-work/{0-distro/ubuntu_20.04 distro/centos_8.2_kubic_stable fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:51:05 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146663/ [6146665] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:19:03 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146665/ [6146667] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:27:46 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146667/ [6146669] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:07:55 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146669/ [6146672] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:38:42 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146672/ [6146675] rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:21:21 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146675/ [6146677] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:26:40 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146677/ [6146681] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} time: 00:14:08 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146681/ [6146685] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{rhel_8}} time: 00:17:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146685/ [6146687] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:29 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146687/ [6146691] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:17 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146691/ [6146693] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:11:20 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146693/ [6146695] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable task/test_cephadm} time: 00:18:10 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146695/ [6146697] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_18.04}} time: 00:26:11 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146697/ [6146699] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:31:43 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146699/ [6146701] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/insights} time: 00:22:39 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146701/ [6146703] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 01:37:52 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146703/ [6146705] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 start} time: 00:15:08 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146705/ [6146707] rados/singleton/{all/erasure-code-nonregression msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:06:15 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146707/ [6146711] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04} thrashers/none thrashosds-health workloads/dedup_tier} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146711/ [6146713] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04 start} time: 00:14:11 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146713/ [6146715] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:40 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146715/ [6146717] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{centos_8}} time: 00:29:08 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146717/ [6146721] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 04:17:46 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146721/ [6146723] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:29:50 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146723/ [6146725] rados/singleton/{all/lost-unfound-delete msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:28:50 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146725/ [6146728] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:39:59 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146728/ [6146730] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/many workloads/pool-create-delete} time: 00:19:19 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146730/ [6146732] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:20:47 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146732/ [6146734] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:17:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146734/ [6146736] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:04 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146736/ [6146738] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:35:56 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146738/ [6146740] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:25:27 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146740/ [6146744] rados/singleton/{all/lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04}} time: 00:27:19 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146744/ [6146748] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:11:31 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146748/ [6146750] rados/cephadm/with-work/{0-distro/centos_8.2_kubic_stable distro/rhel_8.3_kubic_stable fixed-2 mode/root msgr/async start tasks/rados_python} time: 01:50:31 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146750/ [6146754] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{rhel_8}} time: 00:18:01 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146754/ [6146756] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:17:01 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146756/ [6146758] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_18.04} tasks/rados_stress_watch} time: 00:15:26 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146758/ [6146760] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:26:14 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146760/ [6146761] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:39:27 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146761/ [6146767] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:47:22 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146767/ [6146769] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146769/ [6146775] rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable distro/rhel_8.3_kubic_stable fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 01:59:03 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146775/ [6146777] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:14:11 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146777/ [6146781] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:19:14 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146781/ [6146783] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{ubuntu_18.04}} time: 00:13:40 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146783/ [6146785] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:11:26 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146785/ [6146789] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:28 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146789/ [6146791] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:13:43 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146791/ [6146793] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:51:49 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146793/ [6146795] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_5925} time: 00:07:48 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146795/ [6146797] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:26:23 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146797/ [6146799] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:17:45 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146799/ [6146801] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_18.04} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:22:38 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146801/ [6146805] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:21:07 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146805/ [6146809] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:57 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146809/ [6146811] rados/singleton/{all/mon-auth-caps msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_18.04}} time: 00:08:15 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146811/ [6146815] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:13:07 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146815/ [6146817] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:32 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146817/ [6146819] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:21:31 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146819/ [6146821] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/progress} time: 00:17:06 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146821/ [6146823] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:36:58 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146823/ [6146825] rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 start} time: 00:34:45 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146825/ [6146827] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{centos_8}} time: 00:10:17 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146827/ [6146829] rados/singleton/{all/mon-config-key-caps msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:08:16 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146829/ [6146831] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:11:03 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146831/ [6146833] rados/cephadm/smoke-roleless/{distro/centos_8.2_kubic_stable start} time: 00:24:12 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146833/ [6146837] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146837/ [6146841] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_18.04} tasks/dashboard} time: 01:06:50 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146841/ [6146843] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_api_tests} time: 00:25:14 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146843/ [6146845] rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_18.04} tasks/mon_recovery} time: 00:09:29 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146845/ [6146847] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:11:36 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146847/ [6146849] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:29:11 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146849/ [6146851] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:12:21 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146851/ [6146853] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:17 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146853/ [6146855] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:05 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146855/ [6146857] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:44 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146857/ [6146861] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 00:57:02 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146861/ [6146863] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 00:40:18 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146863/ [6146865] rados/singleton/{all/mon-config msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:09:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146865/ [6146867] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:30:34 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146867/ [6146869] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{ubuntu_latest}} time: 00:07:59 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146869/ [6146873] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable task/test_adoption} time: 00:12:54 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146873/ [6146875] rados/singleton/{all/osd-backfill msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:17:01 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146875/ [6146877] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_18.04} tasks/prometheus} time: 00:10:55 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146877/ [6146879] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:34:17 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146879/ [6146881] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/set-chunk-promote-flush} time: 00:22:01 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146881/ [6146883] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:12 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146883/ [6146889] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:20:15 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146889/ [6146892] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{ubuntu_18.04}} time: 00:07:05 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146892/ [6146894] rados/cephadm/with-work/{0-distro/ubuntu_20.04 distro/ubuntu_20.04 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:23:17 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146894/ [6146896] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:15:13 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146896/ [6146904] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:09 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146904/ [6146906] rados/multimon/{clusters/6 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:17:37 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146906/ [6146908] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:44 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146908/ [6146910] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:28 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146910/ [6146912] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:14:50 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146912/ [6146914] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:22:27 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146914/ [6146916] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:48:51 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146916/ [6146918] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_18.04} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:20:36 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146918/ [6146920] rados/cephadm/smoke/{distro/rhel_8.3_kubic_stable fixed-2 start} time: 00:58:22 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146920/ [6146926] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146926/ [6146929] rados/singleton/{all/peer msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146929/ [6146932] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{ubuntu_18.04}} time: 00:06:02 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146932/ [6146935] rados/cephadm/smoke-roleless/{distro/rhel_8.3_kubic_stable start} time: 00:37:16 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146935/ [6146938] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_18.04} tasks/workunits} time: 00:07:18 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146938/ [6146941] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:33:19 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146941/ [6146944] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:20:06 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146944/ [6146947] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:11:30 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146947/ [6146962] rados/singleton/{all/pg-autoscaler msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:08:55 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146962/ [6146965] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:25:08 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146965/ [6146971] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:19:45 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146971/ [6146974] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{ubuntu_latest}} time: 00:06:46 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146974/ [6146977] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:48 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146977/ [6146980] rados/cephadm/with-work/{0-distro/centos_8.2_kubic_stable distro/centos_8.2_kubic_stable fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 01:14:12 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146980/ [6146983] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146983/ [6146986] rados/singleton/{all/pg-removal-interruption msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:08:23 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146986/ [6146989] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:17:34 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146989/ [6146992] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:25 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146992/ [6146995] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146995/ [6146998] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:24:33 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6146998/ [6147003] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:38:19 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147003/ [6147006] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:25:44 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147006/ [6147009] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:28:30 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147009/ [6147014] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard} time: 01:04:05 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147014/ [6147017] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/crash} time: 00:19:34 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147017/ [6147020] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:37:31 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147020/ [6147023] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:29:13 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147023/ [6147025] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:18:24 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147025/ [6147028] rados/singleton/{all/radostool msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:16:56 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147028/ [6147031] rados/cephadm/workunits/{0-distro/centos_8.2_kubic_stable task/test_orch_cli} time: 00:24:36 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147031/ [6147034] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:28:34 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147034/ [6147037] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:34:17 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147037/ [6147040] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{centos_8}} time: 00:08:34 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147040/ [6147043] rados/cephadm/smoke/{distro/ubuntu_20.04 fixed-2 start} time: 00:15:55 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147043/ [6147046] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:53 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147046/ [6147049] rados/singleton/{all/random-eio msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_18.04}} time: 00:20:02 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147049/ [6147051] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:21:49 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147051/ [6147053] rados/cephadm/smoke-roleless/{distro/ubuntu_20.04 start} time: 00:14:04 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147053/ [6147056] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:35:17 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147056/ [6147059] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:31:43 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147059/ [6147062] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:55 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147062/ [6147065] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147065/ [6147071] rados/multimon/{clusters/21 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:22:13 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147071/ [6147074] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_18.04} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:43 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147074/ [6147077] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:01 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147077/ [6147080] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:21:30 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147080/ [6147083] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:21:54 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147083/ [6147086] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:37:53 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147086/ [6147089] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{rhel_8}} time: 00:18:40 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147089/ [6147092] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:25 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147092/ [6147095] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:20:06 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147095/ [6147104] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/failover} time: 00:13:04 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147104/ [6147107] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:24:21 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147107/ [6147110] rados/cephadm/with-work/{0-distro/centos_8.2_kubic_stable distro/centos_8.2_kubic_stable fixed-2 mode/root msgr/async-v1only start tasks/rados_python} time: 01:05:48 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147110/ [6147113] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:13:19 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147113/ [6147116] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_18.04}} time: 02:39:34 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147116/ [6147119] rados/singleton/{all/resolve_stuck_peering msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:07:24 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147119/ [6147122] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_18.04} tasks/repair_test} time: 00:14:55 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147122/ [6147124] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:23:00 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147124/ [6147127] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:21:04 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147127/ [6147133] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:09:29 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147133/ [6147136] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{ubuntu_latest}} time: 00:07:07 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147136/ [6147139] rados/singleton/{all/test-crash msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:08:09 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147139/ [6147145] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:49 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147145/ [6147148] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:27:50 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147148/ [6147153] rados/cephadm/with-work/{0-distro/rhel_8.3_kubic_stable distro/rhel_8.3_kubic_stable fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 01:58:51 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147153/ [6147156] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:26:55 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147156/ [6147162] rados/multimon/{clusters/3 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:02 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147162/ [6147165] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:20:24 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147165/ [6147168] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:11 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147168/ [6147171] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 01:06:37 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147171/ [6147175] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:32:22 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147175/ [6147176] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:36:44 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147176/ [6147179] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:13:05 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147179/ [6147182] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:23:31 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147182/ [6147187] rados/singleton/{all/thrash-backfill-full msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 01:22:22 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147187/ [6147189] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_18.04} tasks/scrub_test} time: 00:10:39 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147189/ [6147191] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:36:41 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147191/ [6147192] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{ubuntu_18.04}} time: 00:07:57 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147192/ [6147194] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}} time: 00:12:22 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147194/ [6147197] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_18.04}} time: 00:30:13 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147197/ [6147201] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147201/ [6147205] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:34:31 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147205/ [6147207] rados/cephadm/smoke/{distro/centos_8.2_kubic_stable fixed-2 start} time: 00:34:04 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147207/ [6147209] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:37:32 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147209/ [6147211] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:57 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147211/ [6147213] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:10 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147213/ [6147215] rados/cephadm/smoke-roleless/{distro/centos_8.2_kubic_stable start} time: 00:24:43 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147215/ [6147217] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:18:26 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147217/ [6147219] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{ubuntu_18.04}} time: 00:08:07 info: http://pulpito.ceph.com/yuriw-2021-06-02_18:25:56-rados-wip-yuri8-testing-2021-06-02-1014-octopus-distro-basic-smithi/6147219/