2023-08-15T14:43:57.054 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T14:43:57.055 INFO:teuthology.results:subset: '111/120000' 2023-08-15T14:43:57.055 INFO:teuthology.results:seed: '6581' 2023-08-15T18:50:29.109 INFO:root:teuthology version: 0.0.1.dev183+g5435569 2023-08-15T18:50:29.152 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-08-16T00:31:08.488 INFO:teuthology.results:Tests finished! gathering results... 2023-08-16T00:31:57.538 INFO:scrape:Found 427 jobs 2023-08-16T00:32:01.039 INFO:scrape:Found 9 distinct failure reasons 2023-08-16T00:32:01.040 INFO:scrape:Failure: Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=602c756589be2a5f0615079ebe6308eccb10f42c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' 2023-08-16T00:32:01.040 INFO:scrape:1 jobs: ['7368237'] 2023-08-16T00:32:01.040 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/filestore-xfs', 'rados', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'supported-random-distro$/{rhel_8}}'] 2023-08-16T00:32:01.041 INFO:scrape: 2023-08-16T00:32:01.041 INFO:scrape:Failure: 'type' object is not subscriptable 2023-08-16T00:32:01.041 INFO:scrape:5 jobs: ['7368333', '7368547', '7368443', '7368230', '7368122'] 2023-08-16T00:32:01.042 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_nfs}'] 2023-08-16T00:32:01.042 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_nfs}'] 2023-08-16T00:32:01.042 INFO:scrape: 2023-08-16T00:32:01.042 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=602c756589be2a5f0615079ebe6308eccb10f42c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2023-08-16T00:32:01.043 INFO:scrape:1 jobs: ['7368362'] 2023-08-16T00:32:01.043 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/none', 'thrashosds-health', 'workloads/rados_api_tests}'] 2023-08-16T00:32:01.043 INFO:scrape: 2023-08-16T00:32:01.044 INFO:scrape:Failure: Failed to reconnect to smithi008 2023-08-16T00:32:01.044 INFO:scrape:7 jobs: ['7368357', '7368125', '7368475', '7368140', '7368307', '7368337', '7368502'] 2023-08-16T00:32:01.044 INFO:scrape:suites intersection: [] 2023-08-16T00:32:01.045 INFO:scrape:suites union: ['0-nvme-loop', '1-install/mimic', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-start', '2-services/nfs-ingress-rgw-user', '3-final}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'distro/ubuntu_18.04', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke/{0-nvme-loop', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'start}', 'thrashers/careful', 'thrashers/mapgap', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}'] 2023-08-16T00:32:01.045 INFO:scrape: 2023-08-16T00:32:01.045 INFO:scrape:Failure: "2023-08-15T16:24:17.631518+0000 mon.a (mon.0) 484 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log 2023-08-16T00:32:01.046 INFO:scrape:4 jobs: ['7368241', '7368539', '7368496', '7368145'] 2023-08-16T00:32:01.046 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/few', 'openstack}', 'rados'] 2023-08-16T00:32:01.046 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'msgr-failures/few', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/verify/{centos_latest', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_cls_all', 'tasks/rados_cls_all}', 'validater/lockdep}'] 2023-08-16T00:32:01.047 INFO:scrape: 2023-08-16T00:32:01.047 INFO:scrape:Failure: Command failed on smithi139 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:602c756589be2a5f0615079ebe6308eccb10f42c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3623f56e-3b8a-11ee-9b38-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2023-08-16T00:32:01.047 INFO:scrape:1 jobs: ['7368292'] 2023-08-16T00:32:01.047 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'rados/cephadm/osds/{0-distro/ubuntu_18.04'] 2023-08-16T00:32:01.048 INFO:scrape: 2023-08-16T00:32:01.048 INFO:scrape:Failure: Command failed on smithi055 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6ac942c-3b89-11ee-9b38-001a4aab830c -- ceph orch daemon add osd smithi055:vg_nvme/lv_2' 2023-08-16T00:32:01.048 INFO:scrape:1 jobs: ['7368269'] 2023-08-16T00:32:01.049 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'roles', 'tasks/{0-from/v16.2.4'] 2023-08-16T00:32:01.049 INFO:scrape: 2023-08-16T00:32:01.049 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=602c756589be2a5f0615079ebe6308eccb10f42c 2023-08-16T00:32:01.049 INFO:scrape:2 jobs: ['7368266', '7368479'] 2023-08-16T00:32:01.050 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}'] 2023-08-16T00:32:01.050 INFO:scrape:suites union: ['rados/cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}'] 2023-08-16T00:32:01.050 INFO:scrape: 2023-08-16T00:32:01.051 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi006 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=602c756589be2a5f0615079ebe6308eccb10f42c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2023-08-16T00:32:01.051 INFO:scrape:2 jobs: ['7368157', '7368371'] 2023-08-16T00:32:01.051 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'task/test_e2e}'] 2023-08-16T00:32:01.051 INFO:scrape:suites union: ['rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'task/test_e2e}'] 2023-08-16T00:32:01.052 INFO:scrape: 2023-08-16T00:32:01.068 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/ failed: 24 dead: 0 running: 0 waiting: 0 queued: 0 passed: 403 Fail ================================================================= [7368122] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:17:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368122/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368122/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d869d565c22d41df9bd08283b6daf4b3 'type' object is not subscriptable [7368125] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368125/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368125/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9fa6396c1f4a4ca3bb3905698d630413 Failed to reconnect to smithi037 [7368140] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368140/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368140/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e62ca557aad943828dcb6c832c7f19b4 Failed to reconnect to smithi081 [7368145] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:19:58 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368145/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368145/ "2023-08-15T15:17:24.460149+0000 mon.a (mon.0) 477 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7368157] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:23:55 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368157/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368157/ sentry: https://sentry.ceph.com/organizations/ceph/?query=200d0eeeda924be78d2741e83faf60a4 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi006 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=602c756589be2a5f0615079ebe6308eccb10f42c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7368230] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:14:52 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368230/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e042005c6cf14d4d9261cc415131e86c 'type' object is not subscriptable [7368237] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:14:44 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368237/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368237/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1f4b65b2e292418288557d2b30b521d4 Command failed (workunit test rados/test_envlibrados_for_rocksdb.sh) on smithi066 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=602c756589be2a5f0615079ebe6308eccb10f42c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/rados/test_envlibrados_for_rocksdb.sh' [7368241] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:20:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368241/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368241/ "2023-08-15T16:24:17.631518+0000 mon.a (mon.0) 484 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7368266] rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} ----------------------------------------------------------------- time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368266/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368266/ sentry: https://sentry.ceph.com/organizations/ceph/?query=145f0a4d21534f7eb789681c1e3298ef Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =602c756589be2a5f0615079ebe6308eccb10f42c [7368269] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:16:35 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368269/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=97bf06b7fb894078a131eb6579ece649 Command failed on smithi055 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a6ac942c-3b89-11ee-9b38-001a4aab830c -- ceph orch daemon add osd smithi055:vg_nvme/lv_2' [7368292] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:16:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368292/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368292/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3fe0baadd7cc4475bf4b53bce917e7e9 Command failed on smithi139 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:602c756589be2a5f0615079ebe6308eccb10f42c shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3623f56e-3b8a-11ee-9b38-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [7368307] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368307/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368307/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1393b1abf584d4f89ce276ac8be3956 Failed to reconnect to smithi031 [7368333] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:15:06 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368333/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368333/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f35912082bc04ce1abc55ca9e34042b0 'type' object is not subscriptable [7368337] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368337/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368337/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3e24e867011c44f2aaddbb18cf4611db Failed to reconnect to smithi169 [7368357] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368357/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368357/ sentry: https://sentry.ceph.com/organizations/ceph/?query=64ff2194b000488abc46bac8bdfb3e68 Failed to reconnect to smithi008 [7368362] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:37:30 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368362/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368362/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ff9acf0bb354ad3ae3d2c3266afab26 Command failed (workunit test rados/test.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=602c756589be2a5f0615079ebe6308eccb10f42c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [7368371] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:31:08 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368371/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368371/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d981312f5c314d20afba4f534ed96963 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi046 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=602c756589be2a5f0615079ebe6308eccb10f42c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7368443] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:14:35 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368443/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368443/ sentry: https://sentry.ceph.com/organizations/ceph/?query=89a90d13228c4a83b961c4e4ec13f1e7 'type' object is not subscriptable [7368475] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368475/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368475/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3e1556a58b924862be9176908fc969a3 Failed to reconnect to smithi050 [7368479] rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} ----------------------------------------------------------------- time: 00:08:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368479/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368479/ sentry: https://sentry.ceph.com/organizations/ceph/?query=57ed15c709b5427c959571d00fdd862d Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =602c756589be2a5f0615079ebe6308eccb10f42c [7368496] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:20:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368496/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368496/ "2023-08-15T18:50:02.790632+0000 mon.a (mon.0) 516 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7368502] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368502/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368502/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a9659772937c45e0a046b23b1914bb5e Failed to reconnect to smithi142 [7368539] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:20:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368539/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368539/ "2023-08-15T19:09:17.372375+0000 mon.a (mon.0) 483 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log [7368547] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:19:14 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368547/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368547/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e259d77de43145bf9181bdf36bedd098 'type' object is not subscriptable Pass ================================================================= [7368123] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:40:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368123/ [7368124] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368124/ [7368126] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368126/ [7368127] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:34:30 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368127/ [7368128] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:27:29 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368128/ [7368129] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:44:12 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368129/ [7368130] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:31:05 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368130/ [7368131] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:33:20 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368131/ [7368132] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:16:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368132/ [7368133] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:15:13 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368133/ [7368134] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:18:26 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368134/ [7368135] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368135/ [7368136] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368136/ [7368137] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:13:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368137/ [7368138] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:22:12 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368138/ [7368139] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368139/ [7368141] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:38:51 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368141/ [7368142] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:23:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368142/ [7368143] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:45 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368143/ [7368144] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:16:41 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368144/ [7368146] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} time: 00:28:20 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368146/ [7368147] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:36:23 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368147/ [7368148] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:26:34 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368148/ [7368149] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:21:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368149/ [7368150] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} tasks/dashboard} time: 01:04:43 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368150/ [7368151] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:10:01 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368151/ [7368152] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:21:23 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368152/ [7368153] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:29:29 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368153/ [7368154] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:21:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368154/ [7368155] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:48:17 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368155/ [7368156] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:26:10 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368156/ [7368158] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:01 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368158/ [7368159] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:37:51 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368159/ [7368160] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/workunits} time: 00:14:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368160/ [7368161] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:33:27 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368161/ [7368162] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:30:46 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368162/ [7368163] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:23:54 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368163/ [7368164] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli} time: 00:12:55 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368164/ [7368165] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:12 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368165/ [7368166] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:26:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368166/ [7368167] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:45:06 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368167/ [7368168] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:34 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368168/ [7368169] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:22:52 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368169/ [7368170] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368170/ [7368171] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:14:18 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368171/ [7368172] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:02 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368172/ [7368173] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:14:56 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368173/ [7368174] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:29:31 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368174/ [7368175] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:24:24 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368175/ [7368176] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:43:08 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368176/ [7368177] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:33:19 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368177/ [7368178] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:25:07 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368178/ [7368179] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:25:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368179/ [7368180] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:07 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368180/ [7368181] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:43:17 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368181/ [7368182] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:15:50 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368182/ [7368183] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368183/ [7368184] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368184/ [7368185] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:34:27 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368185/ [7368186] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:23:41 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368186/ [7368187] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:16:28 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368187/ [7368188] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:41 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368188/ [7368189] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:19:13 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368189/ [7368190] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368190/ [7368191] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368191/ [7368192] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:12:23 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368192/ [7368193] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:21 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368193/ [7368194] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:54:06 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368194/ [7368195] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:27:15 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368195/ [7368196] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:35:47 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368196/ [7368197] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:13:16 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368197/ [7368198] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:55 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368198/ [7368199] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/crash} time: 00:17:15 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368199/ [7368200] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:35:05 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368200/ [7368201] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:13:20 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368201/ [7368202] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 01:11:27 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368202/ [7368203] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:13 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368203/ [7368204] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:09:05 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368204/ [7368205] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:37 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368205/ [7368206] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:41 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368206/ [7368207] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:59:36 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368207/ [7368208] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:19:51 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368208/ [7368209] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:35:55 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368209/ [7368210] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:29:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368210/ [7368211] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:46 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368211/ [7368212] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:21:55 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368212/ [7368213] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:07 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368213/ [7368214] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:19:28 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368214/ [7368215] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:48:58 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368215/ [7368216] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:19:23 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368216/ [7368217] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368217/ [7368218] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:14:33 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368218/ [7368219] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:25:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368219/ [7368220] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:32:13 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368220/ [7368221] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:24 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368221/ [7368222] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:23:13 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368222/ [7368223] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:39 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368223/ [7368224] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:53:34 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368224/ [7368225] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:12:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368225/ [7368226] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:50 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368226/ [7368227] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:23:13 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368227/ [7368228] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:17:42 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368228/ [7368229] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:30 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368229/ [7368231] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:34:43 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368231/ [7368232] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:21:38 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368232/ [7368233] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:18:42 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368233/ [7368234] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:35:33 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368234/ [7368235] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:30:19 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368235/ [7368236] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:27:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368236/ [7368238] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:16 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368238/ [7368239] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:36 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368239/ [7368240] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:33:28 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368240/ [7368242] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/failover} time: 00:16:36 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368242/ [7368243] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} time: 00:34:56 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368243/ [7368244] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:30:01 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368244/ [7368245] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:22:43 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368245/ [7368246] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:41:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368246/ [7368247] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:17:10 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368247/ [7368248] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:32:24 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368248/ [7368249] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:22:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368249/ [7368250] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:14:36 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368250/ [7368251] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:13:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368251/ [7368252] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:29 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368252/ [7368253] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:21:19 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368253/ [7368254] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:18:37 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368254/ [7368255] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368255/ [7368256] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:24:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368256/ [7368257] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:37:01 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368257/ [7368258] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:13:09 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368258/ [7368259] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:08 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368259/ [7368260] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} time: 00:30:06 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368260/ [7368261] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:03:35 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368261/ [7368262] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:37:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368262/ [7368263] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:57:01 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368263/ [7368264] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:16:42 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368264/ [7368265] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:31 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368265/ [7368267] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 01:01:13 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368267/ [7368268] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368268/ [7368270] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:30:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368270/ [7368271] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:15:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368271/ [7368272] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:17:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368272/ [7368273] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:16:19 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368273/ [7368274] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:39:12 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368274/ [7368275] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:15:45 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368275/ [7368276] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:29 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368276/ [7368277] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} time: 00:34:55 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368277/ [7368278] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:33:43 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368278/ [7368279] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:20:34 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368279/ [7368280] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:29:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368280/ [7368281] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:33:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368281/ [7368282] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:17:24 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368282/ [7368283] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:41:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368283/ [7368284] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:10:56 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368284/ [7368285] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/insights} time: 00:30:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368285/ [7368286] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} time: 00:15:29 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368286/ [7368287] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368287/ [7368288] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:17:24 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368288/ [7368289] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:34:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368289/ [7368290] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368290/ [7368291] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:32:23 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368291/ [7368293] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:12:08 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368293/ [7368294] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:17:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368294/ [7368295] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:20 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368295/ [7368296] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:28:52 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368296/ [7368297] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:28:07 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368297/ [7368298] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:23:45 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368298/ [7368299] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:33:20 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368299/ [7368300] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:18:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368300/ [7368301] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:43 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368301/ [7368302] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368302/ [7368303] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:23:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368303/ [7368304] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:09:41 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368304/ [7368305] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:20:30 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368305/ [7368306] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:08:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368306/ [7368308] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:30:10 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368308/ [7368309] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:14:43 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368309/ [7368310] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368310/ [7368311] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:22:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368311/ [7368312] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:40:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368312/ [7368313] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:22:33 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368313/ [7368314] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:40:45 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368314/ [7368315] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:33:18 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368315/ [7368316] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:40:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368316/ [7368317] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:19:02 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368317/ [7368318] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:18:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368318/ [7368319] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:08:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368319/ [7368320] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:18:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368320/ [7368321] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:55 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368321/ [7368322] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:46 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368322/ [7368323] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:12:56 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368323/ [7368324] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:27:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368324/ [7368325] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:31:03 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368325/ [7368326] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:33:47 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368326/ [7368327] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:18:30 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368327/ [7368328] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:06 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368328/ [7368329] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:19:23 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368329/ [7368330] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:56 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368330/ [7368331] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:44:24 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368331/ [7368332] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:39:03 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368332/ [7368334] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:32:18 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368334/ [7368335] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368335/ [7368336] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:13:27 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368336/ [7368338] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368338/ [7368339] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:18:37 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368339/ [7368340] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:32:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368340/ [7368341] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:46:10 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368341/ [7368342] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:24:59 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368342/ [7368343] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} time: 00:31:05 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368343/ [7368344] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368344/ [7368345] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:32:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368345/ [7368346] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:21 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368346/ [7368347] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:13:44 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368347/ [7368348] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368348/ [7368349] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:41:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368349/ [7368350] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:20:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368350/ [7368351] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:32:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368351/ [7368352] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:51 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368352/ [7368353] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:54 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368353/ [7368354] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:21:44 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368354/ [7368355] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:07 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368355/ [7368356] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:29:27 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368356/ [7368358] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:11:09 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368358/ [7368359] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:23:14 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368359/ [7368360] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368360/ [7368361] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} time: 00:29:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368361/ [7368363] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:54 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368363/ [7368364] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} tasks/dashboard} time: 01:06:49 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368364/ [7368365] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:25:58 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368365/ [7368366] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 02:41:26 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368366/ [7368367] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:51:55 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368367/ [7368368] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 01:41:50 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368368/ [7368369] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:21:37 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368369/ [7368370] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:07 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368370/ [7368372] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/progress} time: 00:25:18 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368372/ [7368373] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:26:36 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368373/ [7368374] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:38 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368374/ [7368375] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:11:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368375/ [7368376] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:30:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368376/ [7368377] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 01:24:54 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368377/ [7368378] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:13:49 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368378/ [7368379] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:13:08 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368379/ [7368380] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:27 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368380/ [7368381] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:27 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368381/ [7368382] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:32:03 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368382/ [7368383] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:59:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368383/ [7368384] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:15:59 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368384/ [7368385] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:13:56 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368385/ [7368386] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:12:45 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368386/ [7368387] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} time: 00:51:21 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368387/ [7368388] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:30:03 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368388/ [7368389] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:34:44 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368389/ [7368390] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:08:44 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368390/ [7368391] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:12:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368391/ [7368392] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:31:59 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368392/ [7368393] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368393/ [7368394] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:40:28 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368394/ [7368395] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:38 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368395/ [7368396] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:17:45 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368396/ [7368397] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 00:48:05 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368397/ [7368398] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} time: 00:22:52 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368398/ [7368399] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:24:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368399/ [7368400] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:23:12 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368400/ [7368401] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 01:15:08 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368401/ [7368402] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:15:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368402/ [7368403] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:17:38 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368403/ [7368404] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:31 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368404/ [7368405] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:13:18 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368405/ [7368406] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:21:24 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368406/ [7368407] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:34:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368407/ [7368408] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:17:37 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368408/ [7368409] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:25:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368409/ [7368410] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:37 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368410/ [7368411] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368411/ [7368412] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:21:43 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368412/ [7368413] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:21:56 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368413/ [7368414] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 01:30:10 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368414/ [7368415] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:59:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368415/ [7368416] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:27 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368416/ [7368417] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:09:09 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368417/ [7368418] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:26:38 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368418/ [7368419] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:26 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368419/ [7368420] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:37:01 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368420/ [7368421] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:30:47 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368421/ [7368422] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:17:30 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368422/ [7368423] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:18:38 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368423/ [7368424] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:31 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368424/ [7368425] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:10 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368425/ [7368426] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:18:21 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368426/ [7368427] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:16:15 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368427/ [7368428] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:08 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368428/ [7368429] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:26:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368429/ [7368430] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:44:31 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368430/ [7368431] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:13:43 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368431/ [7368432] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:14 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368432/ [7368433] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:22:58 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368433/ [7368434] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:17:30 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368434/ [7368435] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:59 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368435/ [7368436] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:15:56 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368436/ [7368437] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:26:07 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368437/ [7368438] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:52:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368438/ [7368439] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368439/ [7368440] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:18:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368440/ [7368441] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:14:41 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368441/ [7368442] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:15:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368442/ [7368444] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:21:45 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368444/ [7368445] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:16:08 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368445/ [7368446] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:27:12 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368446/ [7368447] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368447/ [7368448] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:02:03 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368448/ [7368449] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:26:05 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368449/ [7368450] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:34 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368450/ [7368451] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:36:44 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368451/ [7368452] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:14:19 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368452/ [7368453] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 01:00:13 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368453/ [7368454] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368454/ [7368455] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/workunits} time: 00:13:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368455/ [7368456] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:35:05 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368456/ [7368457] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:36:03 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368457/ [7368458] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:20:04 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368458/ [7368459] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:42:10 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368459/ [7368460] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} time: 03:16:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368460/ [7368461] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:28:19 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368461/ [7368462] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:18:23 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368462/ [7368463] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:27 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368463/ [7368464] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:12:12 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368464/ [7368465] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:39:59 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368465/ [7368466] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368466/ [7368467] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:44 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368467/ [7368468] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:16:49 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368468/ [7368469] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:23:33 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368469/ [7368470] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:17:43 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368470/ [7368471] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} time: 00:27:11 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368471/ [7368472] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} time: 00:32:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368472/ [7368473] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:35:06 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368473/ [7368474] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} time: 00:18:05 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368474/ [7368476] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:32:17 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368476/ [7368477] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368477/ [7368478] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:19:35 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368478/ [7368480] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:34 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368480/ [7368481] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:34:44 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368481/ [7368482] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:45 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368482/ [7368483] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:31:41 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368483/ [7368484] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:15:42 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368484/ [7368485] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} time: 00:29:58 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368485/ [7368486] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/rgw 3-final} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368486/ [7368487] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:15:56 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368487/ [7368488] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:16:19 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368488/ [7368489] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:51:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368489/ [7368490] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:44:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368490/ [7368491] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:12:05 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368491/ [7368492] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368492/ [7368493] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368493/ [7368494] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:35:38 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368494/ [7368495] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:31:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368495/ [7368497] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:13:29 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368497/ [7368498] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/crash} time: 00:18:55 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368498/ [7368499] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:29:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368499/ [7368500] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:03 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368500/ [7368501] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:40:33 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368501/ [7368503] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:52:38 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368503/ [7368504] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:18:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368504/ [7368505] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:24:57 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368505/ [7368506] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:16:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368506/ [7368507] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368507/ [7368508] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:29:02 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368508/ [7368509] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:20:13 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368509/ [7368510] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 01:07:36 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368510/ [7368511] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:21:17 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368511/ [7368512] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368512/ [7368513] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:59 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368513/ [7368514] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368514/ [7368515] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:23:06 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368515/ [7368516] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:30:24 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368516/ [7368517] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:34:23 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368517/ [7368518] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 01:45:49 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368518/ [7368519] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:37 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368519/ [7368520] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:20:53 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368520/ [7368521] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:51 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368521/ [7368522] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:51 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368522/ [7368523] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368523/ [7368524] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:33:50 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368524/ [7368525] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:41:23 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368525/ [7368526] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:24:06 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368526/ [7368527] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:20:50 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368527/ [7368528] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:25 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368528/ [7368529] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:17:51 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368529/ [7368530] rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:17:14 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368530/ [7368531] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 04:58:02 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368531/ [7368532] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:17:48 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368532/ [7368533] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:12 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368533/ [7368534] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:18:32 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368534/ [7368535] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:35:20 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368535/ [7368536] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:34:28 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368536/ [7368537] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:29 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368537/ [7368538] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:13:37 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368538/ [7368540] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync workloads/pool-create-delete} time: 00:21:00 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368540/ [7368541] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:37 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368541/ [7368542] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:21:59 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368542/ [7368543] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368543/ [7368544] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:32:14 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368544/ [7368545] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:22:40 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368545/ [7368546] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:47:46 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368546/ [7368548] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:39:22 info: http://pulpito.ceph.com/yuriw-2023-08-15_14:41:59-rados-wip-yuri8-testing-2023-08-11-0834-pacific-distro-default-smithi/7368548/