2022-03-19T22:55:13.349 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-19T22:55:13.351 INFO:teuthology.results:subset: '111/120000' 2022-03-19T22:55:13.351 INFO:teuthology.results:seed: '1087' 2022-03-20T02:12:14.988 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-20T02:12:15.050 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-20T07:19:43.444 INFO:teuthology.results:Tests finished! gathering results... 2022-03-20T07:20:08.089 INFO:scrape:Found 317 jobs 2022-03-20T07:20:08.409 INFO:scrape:Found 7 distinct failure reasons 2022-03-20T07:20:08.410 INFO:scrape:Failure: Command failed on smithi141 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:0613bec84365d24ea94584d17e6a6d0b292a650f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 95ac97aa-a7db-11ec-8c35-001a4aab830c -- ceph mon dump -f json' 2022-03-20T07:20:08.411 INFO:scrape:1 jobs: ['6746832'] 2022-03-20T07:20:08.411 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-flag}', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools'] 2022-03-20T07:20:08.412 INFO:scrape: 2022-03-20T07:20:08.412 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh 2022-03-20T07:20:08.413 INFO:scrape:1 jobs: ['6747160'] 2022-03-20T07:20:08.413 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'thrashers/force-sync-many', 'workloads/rados_api_tests}'] 2022-03-20T07:20:08.413 INFO:scrape: 2022-03-20T07:20:08.414 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2022-03-20T07:20:08.414 INFO:scrape:1 jobs: ['6746926'] 2022-03-20T07:20:08.415 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2022-03-20T07:20:08.415 INFO:scrape: 2022-03-20T07:20:08.416 INFO:scrape:Failure: Command failed (workunit test mon/mon-bind.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0613bec84365d24ea94584d17e6a6d0b292a650f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh' 2022-03-20T07:20:08.416 INFO:scrape:1 jobs: ['6747175'] 2022-03-20T07:20:08.417 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{rhel_8}', 'workloads/mon}'] 2022-03-20T07:20:08.417 INFO:scrape: 2022-03-20T07:20:08.418 INFO:scrape:Dead: b'2022-03-20T07:16:53.409 DEBUG:teuthology.exit:Finished running handlers' 2022-03-20T07:20:08.418 INFO:scrape:1 jobs: ['6747071'] 2022-03-20T07:20:08.419 INFO:scrape:suites: ['clusters/{fixed-2', 'fast/fast', 'mon_election/classic', 'msgr-failures/osd-delay', 'objectstore/bluestore-bitmap', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{rhel_8}', 'thrashers/minsize_recovery', 'thrashosds-health', 'workloads/ec-small-objects-balanced}'] 2022-03-20T07:20:08.419 INFO:scrape: 2022-03-20T07:20:08.420 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2022-03-20T07:20:08.420 INFO:scrape:1 jobs: ['6747158'] 2022-03-20T07:20:08.420 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'thrashosds-health}', 'validater/valgrind}'] 2022-03-20T07:20:08.421 INFO:scrape: 2022-03-20T07:20:08.421 INFO:scrape:Failure: {'smithi059.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'upgrade': None}}, 'msg': 'Failed to update apt cache: '}} 2022-03-20T07:20:08.422 INFO:scrape:1 jobs: ['6747154'] 2022-03-20T07:20:08.422 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'k8s/1.21', 'net/host', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}'] 2022-03-20T07:20:08.423 INFO:scrape: 2022-03-20T07:20:08.433 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/ failed: 5 dead: 2 running: 0 waiting: 0 queued: 0 passed: 310 Fail ================================================================= [6746832] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746832/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746832/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1fb393b50f0549328e51972b11264fb2 Command failed on smithi141 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:0613bec84365d24ea94584d17e6a6d0b292a650f shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 95ac97aa-a7db-11ec-8c35-001a4aab830c -- ceph mon dump -f json' [6746926] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:24:46 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746926/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746926/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c65827d19bf24611ac933ca2fcc63ff0 Command failed (workunit test rados/test.sh) on smithi105 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0613bec84365d24ea94584d17e6a6d0b292a650f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6747158] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 04:37:02 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747158/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747158/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0fe5a9b3096f41e4bcebf00e500abfce Command failed (workunit test cls/test_cls_rgw.sh) on smithi077 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0613bec84365d24ea94584d17e6a6d0b292a650f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh' [6747160] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_api_tests} ----------------------------------------------------------------- time: 03:35:41 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747160/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747160/ sentry: https://sentry.ceph.com/organizations/ceph/?query=10b890b3a4ef422f933a64c5cfd2e22b Command failed (workunit test rados/test.sh) on smithi185 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0613bec84365d24ea94584d17e6a6d0b292a650f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6747175] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} ----------------------------------------------------------------- time: 01:11:45 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747175/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747175/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca2d56f1f0da491b93263f2592082de0 Command failed (workunit test mon/mon-bind.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0613bec84365d24ea94584d17e6a6d0b292a650f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh' Dead ================================================================= [6747071] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747071/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747071/ hit max job timeout [6747154] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/1.7.2} ----------------------------------------------------------------- time: 00:03:38 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747154/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747154/ sentry: https://sentry.ceph.com/organizations/ceph/?query=755af6ad7c954f54803dfb4a087b0c7b {'smithi059.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'upgrade': None}}, 'msg': 'Failed to update apt cache: '}} Pass ================================================================= [6746804] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:29:20 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746804/ [6746806] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:33 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746806/ [6746808] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:36:53 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746808/ [6746810] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:22:18 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746810/ [6746812] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:36:52 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746812/ [6746814] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect} time: 00:10:20 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746814/ [6746816] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:31 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746816/ [6746818] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_orch_cli} time: 00:14:09 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746818/ [6746820] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:18:19 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746820/ [6746822] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:14:34 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746822/ [6746824] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:06 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746824/ [6746826] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:10 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746826/ [6746828] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:32:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746828/ [6746830] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:22:28 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746830/ [6746834] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:16:36 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746834/ [6746836] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:24:35 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746836/ [6746838] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:16:19 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746838/ [6746840] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/dashboard} time: 01:14:46 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746840/ [6746842] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{centos_8} tasks/crash} time: 00:12:13 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746842/ [6746844] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} time: 00:09:38 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746844/ [6746846] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746846/ [6746848] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.7.2} time: 00:35:41 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746848/ [6746850] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:14:44 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746850/ [6746852] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:11:17 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746852/ [6746854] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:26:14 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746854/ [6746856] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:18:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746856/ [6746858] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:27:57 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746858/ [6746860] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:34:57 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746860/ [6746862] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:32 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746862/ [6746864] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:24:15 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746864/ [6746866] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:09 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746866/ [6746868] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:20:26 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746868/ [6746870] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:04 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746870/ [6746872] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:31 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746872/ [6746874] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:06:39 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746874/ [6746876] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:14:53 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746876/ [6746878] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:11:20 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746878/ [6746880] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:22:53 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746880/ [6746882] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:23:13 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746882/ [6746884] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:35:00 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746884/ [6746886] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:39 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746886/ [6746888] rados/cephadm/workunits/{agent/off mon_election/classic task/test_adoption} time: 00:07:25 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746888/ [6746890] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:17:48 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746890/ [6746892] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746892/ [6746894] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746894/ [6746896] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746896/ [6746898] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:21:55 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746898/ [6746900] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746900/ [6746902] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:20:26 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746902/ [6746904] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:21:37 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746904/ [6746906] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:08:32 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746906/ [6746908] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:43:33 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746908/ [6746910] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:49 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746910/ [6746912] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:13 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746912/ [6746914] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{rhel_8} tasks/failover} time: 00:21:41 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746914/ [6746916] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} time: 00:30:42 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746916/ [6746918] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:31 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746918/ [6746920] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:20:38 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746920/ [6746922] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects} time: 00:20:24 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746922/ [6746924] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:28:02 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746924/ [6746928] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:42 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746928/ [6746930] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:25 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746930/ [6746932] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} time: 00:15:55 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746932/ [6746934] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:39:45 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746934/ [6746936] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:35:40 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746936/ [6746938] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:13 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746938/ [6746940] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:15:34 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746940/ [6746942] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:18:51 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746942/ [6746944] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:14:31 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746944/ [6746946] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:39:35 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746946/ [6746948] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:27:09 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746948/ [6746950] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:15 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746950/ [6746952] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:06:55 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746952/ [6746954] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:06 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746954/ [6746956] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:10 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746956/ [6746958] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:09:24 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746958/ [6746960] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:06:24 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746960/ [6746962] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:26:02 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746962/ [6746964] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:06 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746964/ [6746966] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:38 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746966/ [6746968] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:30:16 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746968/ [6746970] rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm_repos} time: 00:04:42 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746970/ [6746972] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:17:02 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746972/ [6746975] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:17:26 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746975/ [6746976] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/snaps-few-objects} time: 00:35:56 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746976/ [6746978] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:40 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746978/ [6746980] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/insights} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746980/ [6746982] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:20 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746982/ [6746984] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:07:28 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746984/ [6746986] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:32:41 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746986/ [6746988] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:06 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746988/ [6746990] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:08 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746990/ [6746992] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 01:30:39 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746992/ [6746994] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 01:13:26 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746994/ [6746996] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:56 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746996/ [6746998] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:35:49 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6746998/ [6747000] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:56 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747000/ [6747002] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:27 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747002/ [6747004] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} tasks/e2e} time: 00:20:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747004/ [6747006] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/flannel rook/master} time: 00:19:03 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747006/ [6747008] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:31 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747008/ [6747010] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 01:25:33 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747010/ [6747012] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:36:18 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747012/ [6747014] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:18:28 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747014/ [6747016] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:18:56 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747016/ [6747018] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_nfs} time: 00:28:08 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747018/ [6747020] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:38 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747020/ [6747022] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}} time: 02:31:03 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747022/ [6747024] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:28:20 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747024/ [6747026] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:30 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747026/ [6747028] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:12:23 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747028/ [6747030] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:22:50 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747030/ [6747032] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:21:30 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747032/ [6747034] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:29:10 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747034/ [6747036] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:20:00 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747036/ [6747038] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747038/ [6747040] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:29:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747040/ [6747042] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:44 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747042/ [6747044] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747044/ [6747046] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:47 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747046/ [6747048] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:12:27 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747048/ [6747050] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:28:09 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747050/ [6747052] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:26:20 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747052/ [6747054] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:09:28 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747054/ [6747057] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:36:36 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747057/ [6747058] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:19 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747058/ [6747061] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:23:31 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747061/ [6747062] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:21:13 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747062/ [6747064] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:16:29 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747064/ [6747066] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:43:19 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747066/ [6747069] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:22:01 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747069/ [6747073] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:17:01 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747073/ [6747075] rados/cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} time: 00:13:57 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747075/ [6747077] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:19:16 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747077/ [6747078] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:38:56 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747078/ [6747081] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:17:21 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747081/ [6747083] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:09 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747083/ [6747085] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:20:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747085/ [6747087] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:59 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747087/ [6747089] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:31:05 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747089/ [6747090] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:13:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747090/ [6747092] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:28 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747092/ [6747094] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:24 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747094/ [6747097] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:21:03 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747097/ [6747099] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:18:26 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747099/ [6747100] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:10:58 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747100/ [6747103] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:13:08 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747103/ [6747105] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:24:51 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747105/ [6747106] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:20 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747106/ [6747108] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:11:42 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747108/ [6747110] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:36 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747110/ [6747112] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache} time: 00:13:04 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747112/ [6747114] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_adoption} time: 00:07:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747114/ [6747116] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:21:54 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747116/ [6747118] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:19:48 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747118/ [6747121] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:40 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747121/ [6747123] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:37:51 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747123/ [6747124] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 01:04:33 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747124/ [6747126] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/dedup-io-mixed} time: 00:12:26 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747126/ [6747128] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:28:07 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747128/ [6747130] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:08:14 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747130/ [6747132] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:29:13 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747132/ [6747134] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:11:48 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747134/ [6747136] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:05:59 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747136/ [6747139] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:10:33 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747139/ [6747141] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:37 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747141/ [6747143] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:46 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747143/ [6747145] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/dedup-io-snaps} time: 00:12:10 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747145/ [6747146] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:19:56 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747146/ [6747147] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:08 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747147/ [6747148] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:31:48 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747148/ [6747149] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:11:04 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747149/ [6747150] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747150/ [6747151] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:37:24 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747151/ [6747152] rados/cephadm/workunits/{agent/off mon_election/classic task/test_cephadm} time: 00:16:02 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747152/ [6747153] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} tasks/dashboard} time: 01:12:40 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747153/ [6747155] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:26 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747155/ [6747156] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_3.0} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} time: 01:27:45 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747156/ [6747157] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:58:58 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747157/ [6747159] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:47 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747159/ [6747161] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:48 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747161/ [6747162] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:12:53 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747162/ [6747163] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:43:14 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747163/ [6747164] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:10:48 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747164/ [6747165] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:27 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747165/ [6747166] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:10 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747166/ [6747167] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 01:10:07 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747167/ [6747168] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:21:12 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747168/ [6747169] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:35:45 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747169/ [6747170] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:20 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747170/ [6747171] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747171/ [6747172] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:30:12 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747172/ [6747173] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:21:26 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747173/ [6747174] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:19 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747174/ [6747176] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747176/ [6747177] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:36 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747177/ [6747178] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:57 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747178/ [6747179] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench} time: 01:36:26 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747179/ [6747180] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 01:02:48 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747180/ [6747181] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:13 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747181/ [6747182] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747182/ [6747183] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:10:33 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747183/ [6747184] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:04:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747184/ [6747185] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:16:43 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747185/ [6747186] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect} time: 00:11:17 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747186/ [6747187] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747187/ [6747188] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:11:58 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747188/ [6747189] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 01:10:32 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747189/ [6747190] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:54:47 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747190/ [6747191] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:52 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747191/ [6747192] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:11:46 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747192/ [6747193] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:36 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747193/ [6747194] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747194/ [6747195] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:19:40 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747195/ [6747196] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:16:35 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747196/ [6747197] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:28:36 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747197/ [6747198] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747198/ [6747199] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:39 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747199/ [6747200] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:07:35 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747200/ [6747201] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:29:11 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747201/ [6747202] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747202/ [6747203] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:08:11 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747203/ [6747204] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:19:44 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747204/ [6747205] rados/cephadm/workunits/{agent/off mon_election/classic task/test_nfs} time: 00:24:28 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747205/ [6747206] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:21 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747206/ [6747207] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd-backfill} time: 04:24:02 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747207/ [6747208] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:15 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747208/ [6747209] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:59 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747209/ [6747210] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:09:42 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747210/ [6747211] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:13:51 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747211/ [6747212] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:16:10 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747212/ [6747213] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:40 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747213/ [6747214] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747214/ [6747215] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:09:01 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747215/ [6747216] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:57 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747216/ [6747217] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:15 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747217/ [6747218] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:39:19 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747218/ [6747219] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:30:00 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747219/ [6747220] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 01:01:12 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747220/ [6747221] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} time: 00:14:30 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747221/ [6747222] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_workunits} time: 00:30:04 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747222/ [6747223] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:18:09 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747223/ [6747224] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:42 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747224/ [6747225] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:12 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747225/ [6747226] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}} time: 02:14:19 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747226/ [6747227] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:37 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747227/ [6747228] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:18:48 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747228/ [6747229] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:23 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747229/ [6747230] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:19:38 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747230/ [6747231] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:39:18 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747231/ [6747232] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} tasks/e2e} time: 00:20:59 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747232/ [6747233] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/crash} time: 00:20:28 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747233/ [6747234] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} time: 00:20:59 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747234/ [6747235] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:05 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747235/ [6747236] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:14:57 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747236/ [6747237] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747237/ [6747238] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:22:12 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747238/ [6747239] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:58 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747239/ [6747240] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747240/ [6747241] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:59 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747241/ [6747242] rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:12:08 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747242/ [6747243] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:21 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747243/ [6747244] rados/standalone/{supported-random-distro$/{centos_8} workloads/osd} time: 03:14:44 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747244/ [6747245] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:25:53 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747245/ [6747246] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:07:35 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747246/ [6747247] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:09:23 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747247/ [6747248] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:30 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747248/ [6747249] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:07 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747249/ [6747250] rados/cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:07:31 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747250/ [6747251] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:18:12 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747251/ [6747252] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:12 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747252/ [6747253] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:35:00 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747253/ [6747254] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:30:06 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747254/ [6747255] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:40:24 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747255/ [6747256] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} time: 02:17:39 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747256/ [6747257] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:12:19 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747257/ [6747258] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:27:55 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747258/ [6747259] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:42 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747259/ [6747260] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:26:58 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747260/ [6747261] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:33:03 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747261/ [6747262] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747262/ [6747263] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:22:35 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747263/ [6747264] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:02 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747264/ [6747265] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:33:57 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747265/ [6747266] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:33 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747266/ [6747267] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:34 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747267/ [6747268] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:26:25 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747268/ [6747269] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:27:04 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747269/ [6747270] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:06 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747270/ [6747271] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:14 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747271/ [6747272] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} time: 00:15:13 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747272/ [6747273] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:30:57 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747273/ [6747274] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:11:54 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747274/ [6747275] rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:09:28 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747275/ [6747276] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:24 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747276/ [6747277] rados/standalone/{supported-random-distro$/{rhel_8} workloads/scrub} time: 02:57:12 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747277/ [6747278] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:49 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747278/ [6747279] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:09 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747279/ [6747280] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:44:46 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747280/ [6747281] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:26:53 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747281/ [6747282] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:17:00 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747282/ [6747283] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/sync workloads/pool-create-delete} time: 00:15:16 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747283/ [6747284] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} time: 00:31:33 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747284/ [6747285] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{centos_8}} time: 00:32:59 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747285/ [6747286] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:15:56 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747286/ [6747287] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:17 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747287/ [6747288] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:14 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747288/ [6747289] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:39:51 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747289/ [6747290] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:06:45 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747290/ [6747291] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} time: 00:16:38 info: http://pulpito.ceph.com/yuriw-2022-03-19_14:39:53-rados-quincy-distro-default-smithi/6747291/