2022-08-30T01:53:57.626 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-08-30T01:53:57.628 INFO:teuthology.results:subset: '111/120000' 2022-08-30T01:53:57.628 INFO:teuthology.results:seed: '1987' 2022-08-30T05:49:36.310 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-08-30T05:49:36.334 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-08-30T08:23:53.924 INFO:teuthology.results:Tests finished! gathering results... 2022-08-30T08:24:27.182 INFO:scrape:Found 420 jobs 2022-08-30T08:24:43.515 INFO:scrape:Found 8 distinct failure reasons 2022-08-30T08:24:43.517 INFO:scrape:Failure: Command failed on smithi188 with status 1: 'sudo yum -y install ceph-test' 2022-08-30T08:24:43.517 INFO:scrape:212 jobs 2022-08-30T08:24:43.519 INFO:scrape:suites intersection: [] 2022-08-30T08:24:43.520 INFO:scrape:suites union: ['0-kubeadm', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '1-ranks/1', '1-ranks/2', '1-rook', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-inject-leak/mon', '2-inject-leak/none', '2-inject-leak/osd', '2-node-mgr', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '2-thrash', '2-workload/none', '2-workload/radosbench', '3-final', '3-inline/no', '3-inline/yes', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'centos_8.stream_container_tools', 'centos_latest}', 'ceph', 'cluster/1-node', 'cluster/3-node', 'cluster/{12-osds', 'cluster/{fixed-3', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{2-node-mgr}', 'clusters/{fixed-2', 'clusters/{fixed-4', 'conf/{client', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/default/{default', 'd-thrash/none', 'debug/mgr', 'fast/fast', 'fast/normal', 'fixed-2', 'k8s/1.21', 'mds', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mode/packaged', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'net/calico', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'orchestrator_cli}', 'osd}', 'overrides/{pg-warn', 'pool/datapool', 'rados', 'rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0}', 'rados/cephadm/rbd_iscsi/{base/install', 'rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/dashboard/{centos_8.stream_container_tools', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/21', 'rados/multimon/{clusters/9', 'rados/objectstore/{backends/ceph_objectstore_tool', 'rados/objectstore/{backends/filejournal', 'rados/objectstore/{backends/filestore-idempotent', 'rados/objectstore/{backends/keyvaluedb', 'rados/objectstore/{backends/objectcacher-stress', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/export-after-evict', 'rados/singleton-nomsgr/{all/full-tiering', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/msgr', 'rados/singleton-nomsgr/{all/multi-backfill-reject', 'rados/singleton-nomsgr/{all/osd_stale_reads', 'rados/singleton-nomsgr/{all/pool-access', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/admin-socket', 'rados/singleton/{all/backfill-toofull', 'rados/singleton/{all/divergent_priors', 'rados/singleton/{all/divergent_priors2', 'rados/singleton/{all/dump-stuck', 'rados/singleton/{all/ec-lost-unfound', 'rados/singleton/{all/erasure-code-nonregression', 'rados/singleton/{all/lost-unfound', 'rados/singleton/{all/lost-unfound-delete', 'rados/singleton/{all/max-pg-per-osd.from-mon', 'rados/singleton/{all/max-pg-per-osd.from-primary', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/osd-backfill', 'rados/singleton/{all/osd-recovery-incomplete', 'rados/singleton/{all/peer', 'rados/singleton/{all/pg-autoscaler-progress-off', 'rados/singleton/{all/pg-removal-interruption', 'rados/singleton/{all/radostool', 'rados/singleton/{all/random-eio', 'rados/singleton/{all/rebuild-mondb', 'rados/singleton/{all/recovery-preemption', 'rados/singleton/{all/resolve_stuck_peering', 'rados/singleton/{all/test-crash', 'rados/singleton/{all/test_envlibrados_for_rocksdb', 'rados/singleton/{all/thrash-backfill-full', 'rados/singleton/{all/thrash-eio', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'rados/standalone/{supported-random-distro$/{centos_8}', 'rados/standalone/{supported-random-distro$/{rhel_8}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'random-objectstore$/{bluestore-comp-zstd}', 'random-objectstore$/{filestore-xfs}', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'roles', 'rook/1.6.2}', 'rook/master}', 'root}', 'start', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'task/test_adoption}', 'task/test_cephadm}', 'task/test_e2e}', 'task/test_nfs}', 'task/test_orch_cli}', 'tasks/crash}', 'tasks/dashboard}', 'tasks/insights}', 'tasks/module_selftest}', 'tasks/mon_clock_no_skews}', 'tasks/mon_recovery', 'tasks/mon_recovery}', 'tasks/prometheus}', 'tasks/rados_api_tests', 'tasks/rados_api_tests}', 'tasks/rados_cls_all', 'tasks/rados_python}', 'tasks/workunits}', 'tasks/{0-from/v16.2.4', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/force-sync-many', 'thrashers/many', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/one', 'thrashers/pggrow', 'thrashers/sync', 'thrashers/sync-many', 'thrashosds-health', 'thrashosds-health}', 'validater/lockdep}', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/admin_socket_objecter_requests}', 'workloads/cache-agent-big}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/cache-snaps-balanced}', 'workloads/cache-snaps}', 'workloads/ceph_iscsi}', 'workloads/crush}', 'workloads/ec-pool-snaps-few-objects-overwrites}', 'workloads/ec-rados-plugin=clay-k=4-m=2}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-radosbench}', 'workloads/ec-small-objects-balanced}', 'workloads/ec-small-objects-fast-read-overwrites}', 'workloads/ec-small-objects-many-deletes}', 'workloads/ec-small-objects-overwrites}', 'workloads/ec-small-objects}', 'workloads/ec-snaps-few-objects-overwrites}', 'workloads/mgr}', 'workloads/misc}', 'workloads/mon}', 'workloads/pool-create-delete}', 'workloads/rados_5925}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/rados_mon_workunits}', 'workloads/radosbench}', 'workloads/redirect_promote_tests}', 'workloads/redirect_set_object}', 'workloads/redirect}', 'workloads/set-chunks-read}', 'workloads/small-objects-balanced}', 'workloads/small-objects-localized}', 'workloads/small-objects}', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}', 'workloads/write_fadvise_dontneed}'] 2022-08-30T08:24:43.521 INFO:scrape: 2022-08-30T08:24:43.521 INFO:scrape:Failure: Command failed on smithi081 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:1f3c7824d5711a6cd8456a7d17938077a32980ce shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 25b3e4a2-2815-11ed-8431-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2022-08-30T08:24:43.522 INFO:scrape:1 jobs: ['6999234'] 2022-08-30T08:24:43.522 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'rados/cephadm/osds/{0-distro/ubuntu_18.04'] 2022-08-30T08:24:43.523 INFO:scrape: 2022-08-30T08:24:43.523 INFO:scrape:Failure: Command failed on smithi005 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' 2022-08-30T08:24:43.524 INFO:scrape:9 jobs: ['6999445', '6999219', '6999089', '6999252', '6999189', '6999058', '6999126', '6999284', '6999413'] 2022-08-30T08:24:43.524 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'openstack}', 'rados', 'rados/basic/{ceph'] 2022-08-30T08:24:43.525 INFO:scrape:suites union: ['clusters/{fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'tasks/libcephsqlite}', 'tasks/rados_api_tests}', 'tasks/rados_cls_all}', 'tasks/rados_python}', 'tasks/rados_striper}', 'tasks/rados_workunit_loadgen_big}', 'tasks/rados_workunit_loadgen_mix}', 'tasks/rados_workunit_loadgen_mostlyread}'] 2022-08-30T08:24:43.525 INFO:scrape: 2022-08-30T08:24:43.526 INFO:scrape:Failure: Command failed on smithi189 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1f3c7824d5711a6cd8456a7d17938077a32980ce' 2022-08-30T08:24:43.526 INFO:scrape:1 jobs: ['6999290'] 2022-08-30T08:24:43.527 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{ubuntu_latest}}'] 2022-08-30T08:24:43.527 INFO:scrape: 2022-08-30T08:24:43.528 INFO:scrape:Failure: Command failed on smithi012 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84f75114-281b-11ed-8431-001a4aab830c -e sha1=1f3c7824d5711a6cd8456a7d17938077a32980ce -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2022-08-30T08:24:43.528 INFO:scrape:4 jobs: ['6999317', '6999249', '6999106', '6999456'] 2022-08-30T08:24:43.529 INFO:scrape:suites intersection: ['1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools'] 2022-08-30T08:24:43.529 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools'] 2022-08-30T08:24:43.530 INFO:scrape: 2022-08-30T08:24:43.530 INFO:scrape:Failure: {'smithi170.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': True, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '}, {'_ansible_item_label': 'http://download.ceph.com/keys/release.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': False, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/release.asc'}]}} 2022-08-30T08:24:43.531 INFO:scrape:3 jobs: ['6999382', '6999336', '6999313'] 2022-08-30T08:24:43.531 INFO:scrape:suites intersection: [] 2022-08-30T08:24:43.532 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/client-keyring', '3-final}', 'ceph', 'clusters/3-mons', 'clusters/{fixed-2', 'mon_election/classic', 'msgr-failures/few', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'rados/monthrash/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/force-sync-many', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/rados_api_tests}'] 2022-08-30T08:24:43.532 INFO:scrape: 2022-08-30T08:24:43.533 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-yuri3-testing-2022-08-29-1404-pacific 2022-08-30T08:24:43.534 INFO:scrape:1 jobs: ['6999066'] 2022-08-30T08:24:43.535 INFO:scrape: 2022-08-30T08:24:43.536 INFO:scrape:Failure: "2022-08-30T04:18:16.115266+0000 mon.a (mon.0) 28 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log 2022-08-30T08:24:43.536 INFO:scrape:1 jobs: ['6999308'] 2022-08-30T08:24:43.537 INFO:scrape:suites: ['mon_election/connectivity', 'msgr-failures/none', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'rados', 'rados/singleton/{all/ec-inconsistent-hinfo', 'supported-random-distro$/{ubuntu_latest}}'] 2022-08-30T08:24:43.537 INFO:scrape: 2022-08-30T08:24:43.552 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/ failed: 229 dead: 3 running: 0 waiting: 0 queued: 0 passed: 188 Fail ================================================================= [6999048] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_recovery} ----------------------------------------------------------------- time: 00:11:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999048/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999048/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b4798f8e2864475a68799dd37a4e39f Command failed on smithi158 with status 1: 'sudo yum -y install ceph-test' [6999053] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:10:11 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999053/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999053/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d3152c3f69e4b0b9e1065cf50442c1c Command failed on smithi120 with status 1: 'sudo yum -y install ceph-test' [6999054] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:09:55 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999054/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999054/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba7a72af86af406d92a4f6707788c8f2 Command failed on smithi070 with status 1: 'sudo yum -y install ceph-test' [6999055] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:27 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999055/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999055/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2633cb66ed0434bb3c1ab17c1202208 Command failed on smithi099 with status 1: 'sudo yum -y install ceph-test' [6999058] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:09:52 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999058/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999058/ sentry: https://sentry.ceph.com/organizations/ceph/?query=526c1f936d274f348e4dcda60a722658 Command failed on smithi109 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' [6999060] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:10:13 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999060/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999060/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5489fc45fde41dab0ff55ab27582e9f Command failed on smithi146 with status 1: 'sudo yum -y install ceph-test' [6999061] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:10:44 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999061/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999061/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4dbc806daf454e658c5beac4f11774d9 Command failed on smithi105 with status 1: 'sudo yum -y install ceph-test' [6999063] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999063/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999063/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c3c1be799f4493193d8d3bd3991ce1d Command failed on smithi152 with status 1: 'sudo yum -y install ceph-test' [6999064] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:12:02 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999064/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999064/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eeae148571b54ea48b0df2f4a9cbe84e Command failed on smithi088 with status 1: 'sudo yum -y install ceph-test' [6999066] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999066/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999066/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6454e328d6e4a7f90740022d5855496 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref= wip-yuri3-testing-2022-08-29-1404-pacific [6999068] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect} ----------------------------------------------------------------- time: 00:09:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999068/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999068/ sentry: https://sentry.ceph.com/organizations/ceph/?query=881b15b0eb944cb8a9ad7a010cb9e401 Command failed on smithi133 with status 1: 'sudo yum -y install ceph-test' [6999070] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:08:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999070/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999070/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dd0183de448b428ba038faf7b7887f1f Command failed on smithi043 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [6999072] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:09:02 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999072/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1fb125e0e487439aa7a8dcc1838c78ad Command failed on smithi097 with status 1: 'sudo yum -y install ceph-test' [6999073] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:10:00 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999073/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999073/ sentry: https://sentry.ceph.com/organizations/ceph/?query=42353157606f4b57b24f679d28339004 Command failed on smithi131 with status 1: 'sudo yum -y install ceph-test' [6999074] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:09:10 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999074/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999074/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2f775ae32a624eae8f24b02274e05836 Command failed on smithi077 with status 1: 'sudo yum -y install ceph-test' [6999076] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:10:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999076/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999076/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dd76ba2e2ad14928b5a3cf30e56c15a0 Command failed on smithi037 with status 1: 'sudo yum -y install ceph-test' [6999077] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} ----------------------------------------------------------------- time: 00:09:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999077/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999077/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7093407353184be385e06aeca41d48ff Command failed on smithi078 with status 1: 'sudo yum -y install ceph-test' [6999080] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:08:21 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999080/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999080/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3cc467e33d104834a306ad73db4519d0 Command failed on smithi119 with status 1: 'sudo yum -y install ceph-test' [6999081] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999081/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999081/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41aae725d2e24ab38f8ed28cccf0d42b Command failed on smithi143 with status 1: 'sudo yum -y install ceph-test' [6999083] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:07:25 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999083/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999083/ sentry: https://sentry.ceph.com/organizations/ceph/?query=17aaa704b0734c15ba64b9299dbe1e9a Command failed on smithi107 with status 1: 'sudo yum -y install ceph-test' [6999085] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:18 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999085/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999085/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a7b9b63029aa49ebaddd8463b2d7a22c Command failed on smithi012 with status 1: 'sudo yum -y install ceph-test' [6999087] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999087/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999087/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f8c10cf1cbc409baff479a3fa8b9c3d Command failed on smithi099 with status 1: 'sudo yum -y install ceph-test' [6999088] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object} ----------------------------------------------------------------- time: 00:07:37 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999088/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999088/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e900473528d441519bb80cbdef70fa81 Command failed on smithi174 with status 1: 'sudo yum -y install ceph-test' [6999089] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999089/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999089/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b386eb192e514cf69ad2765b991a828b Command failed on smithi070 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' [6999091] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_recovery} ----------------------------------------------------------------- time: 00:08:30 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999091/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999091/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eefdb39d64bf466e9da324bca4efaadd Command failed on smithi120 with status 1: 'sudo yum -y install ceph-test' [6999092] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999092/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999092/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72cd61239ad444fa85cf2edf7c27493d Command failed on smithi153 with status 1: 'sudo yum -y install ceph-test' [6999094] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zstd} supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:04:56 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999094/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999094/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9865e2edea714d43b63796be4203da91 Command failed on smithi105 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6999097] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999097/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999097/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd704cb922fd4ce5b440eb15af24b4aa Command failed on smithi033 with status 1: 'sudo yum -y install ceph-test' [6999098] rados/standalone/{supported-random-distro$/{rhel_8} workloads/crush} ----------------------------------------------------------------- time: 00:08:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999098/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999098/ sentry: https://sentry.ceph.com/organizations/ceph/?query=15d034661f0646a291edc4757e0c3c09 Command failed on smithi043 with status 1: 'sudo yum -y install ceph-test' [6999100] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999100/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5ff8ba26f69647b784c86679c1473ab7 Command failed on smithi197 with status 1: 'sudo yum -y install ceph-test' [6999101] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:07:56 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999101/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999101/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea92e7dae2ef4d83b5a12d9c8c51ec6e Command failed on smithi133 with status 1: 'sudo yum -y install ceph-test' [6999102] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:55 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999102/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999102/ sentry: https://sentry.ceph.com/organizations/ceph/?query=60356678ec294920b5f3306d6a1b82a7 Command failed on smithi124 with status 1: 'sudo yum -y install ceph-test' [6999103] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:08:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999103/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999103/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c3dad89771954761ad73474af46c0eb9 Command failed on smithi088 with status 1: 'sudo yum -y install ceph-test' [6999104] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/workunits} ----------------------------------------------------------------- time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999104/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999104/ sentry: https://sentry.ceph.com/organizations/ceph/?query=60903f4489214dd68acd5b27f27e730b Command failed on smithi040 with status 1: 'sudo yum -y install ceph-test' [6999105] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:07:56 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999105/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999105/ sentry: https://sentry.ceph.com/organizations/ceph/?query=751f16601c1746d59421e527c59a78bb Command failed on smithi131 with status 1: 'sudo yum -y install ceph-test' [6999106] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:21:57 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999106/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999106/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df9846abcdc447e98dfbed6a2e9e5910 Command failed on smithi119 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid addef5f6-280b-11ed-8431-001a4aab830c -e sha1=1f3c7824d5711a6cd8456a7d17938077a32980ce -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6999107] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} ----------------------------------------------------------------- time: 00:08:25 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999107/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999107/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06a5369c8283488d9948226864dab222 Command failed on smithi103 with status 1: 'sudo yum -y install ceph-test' [6999109] rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0} 2-node-mgr orchestrator_cli} ----------------------------------------------------------------- time: 00:08:58 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999109/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999109/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3ff8cd50cba476595aedfe7677dcd07 Command failed on smithi188 with status 1: 'sudo yum -y install ceph-test' [6999110] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:37 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999110/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999110/ sentry: https://sentry.ceph.com/organizations/ceph/?query=96b4a7238c80449ca98698b0bee1eab1 Command failed on smithi143 with status 1: 'sudo yum -y install ceph-test' [6999111] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:07:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999111/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999111/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c95324c0302642daaba6ba7321a21de1 Command failed on smithi002 with status 1: 'sudo yum -y install ceph-test' [6999117] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:08:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999117/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999117/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c40ce9b35f6b4cf18beb145b2ff94903 Command failed on smithi106 with status 1: 'sudo yum -y install ceph-test' [6999119] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999119/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999119/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a7d0dc32b24143c59fcff48fc2af4a12 Command failed on smithi070 with status 1: 'sudo yum -y install ceph-test' [6999120] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} ----------------------------------------------------------------- time: 00:08:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999120/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999120/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b1ad956d2c54e2498710cee844714a4 Command failed on smithi201 with status 1: 'sudo yum -y install ceph-test' [6999121] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:08:22 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999121/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999121/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe2525e1b1484b5d828bde7a598b1cce Command failed on smithi170 with status 1: 'sudo yum -y install ceph-test' [6999122] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:08:16 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999122/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999122/ sentry: https://sentry.ceph.com/organizations/ceph/?query=994e414c954a440b847cf240ef4a5855 Command failed on smithi008 with status 1: 'sudo yum -y install ceph-test' [6999125] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:08:52 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999125/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999125/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d34fec0b98fa4777844e08bbace56b2c Command failed on smithi052 with status 1: 'sudo yum -y install ceph-test' [6999126] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_python} ----------------------------------------------------------------- time: 00:06:47 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999126/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999126/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3af409e2df294465a44f3dbb9359f4c3 Command failed on smithi112 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' [6999127] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999127/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999127/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2276afd9f41d4cdcb8fa14b90c26193f Command failed on smithi197 with status 1: 'sudo yum -y install ceph-test' [6999128] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999128/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999128/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4d70ddb7e0814e52a4a9d72ee4d46c6d Command failed on smithi133 with status 1: 'sudo yum -y install ceph-test' [6999129] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999129/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999129/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a86da85e21af40d0b096050a3429f670 Command failed on smithi124 with status 1: 'sudo yum -y install ceph-test' [6999130] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:48 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999130/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999130/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5e8ed8c636db4c0089f190729618f768 Command failed on smithi083 with status 1: 'sudo yum -y install ceph-test' [6999137] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:21 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999137/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999137/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9aca9e4a9374306adf45b5ed609fcb4 Command failed on smithi188 with status 1: 'sudo yum -y install ceph-test' [6999138] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects} ----------------------------------------------------------------- time: 00:07:37 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999138/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999138/ sentry: https://sentry.ceph.com/organizations/ceph/?query=36974e0c17a54241832ed0cc25d23324 Command failed on smithi179 with status 1: 'sudo yum -y install ceph-test' [6999139] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:07:30 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999139/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999139/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa3d6c1e3c1b47659d8288839b636062 Command failed on smithi149 with status 1: 'sudo yum -y install ceph-test' [6999142] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/crash} ----------------------------------------------------------------- time: 00:07:59 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999142/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999142/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aad348c34d8143ef89425cefe710dcbf Command failed on smithi057 with status 1: 'sudo yum -y install ceph-test' [6999144] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:44 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999144/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999144/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fba848e7db5d476d883b0cbafba38ae9 Command failed on smithi145 with status 1: 'sudo yum -y install ceph-test' [6999145] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:07:51 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999145/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999145/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5d1fdbe3b084390b7aa4f956e2abb2b Command failed on smithi163 with status 1: 'sudo yum -y install ceph-test' [6999146] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999146/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999146/ sentry: https://sentry.ceph.com/organizations/ceph/?query=18046fe83af64ea7b17c332be3a13ea7 Command failed on smithi130 with status 1: 'sudo yum -y install ceph-test' [6999147] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:08:04 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999147/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999147/ sentry: https://sentry.ceph.com/organizations/ceph/?query=666910d6a68f4166af35d6ab1c40609d Command failed on smithi096 with status 1: 'sudo yum -y install ceph-test' [6999148] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999148/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999148/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8890910443fb46b5b396214f0f0a4eea Command failed on smithi106 with status 1: 'sudo yum -y install ceph-test' [6999150] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:08:09 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999150/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999150/ sentry: https://sentry.ceph.com/organizations/ceph/?query=33b215eeb02d482fae67ad2a90dec92a Command failed on smithi112 with status 1: 'sudo yum -y install ceph-test' [6999151] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:08:37 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999151/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999151/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c6bb5230858948f7b81f3e9d6c6f6f10 Command failed on smithi120 with status 1: 'sudo yum -y install ceph-test' [6999152] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} ----------------------------------------------------------------- time: 00:08:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999152/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999152/ sentry: https://sentry.ceph.com/organizations/ceph/?query=08c08b53e4d44067a1cbbddd1fd4c8ad Command failed on smithi087 with status 1: 'sudo yum -y install ceph-test' [6999154] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:08:51 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999154/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999154/ sentry: https://sentry.ceph.com/organizations/ceph/?query=259d1503371a4b9fb94bccee9320aeb0 Command failed on smithi003 with status 1: 'sudo yum -y install ceph-test' [6999159] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:08:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999159/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999159/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed060fdb462e4d9c86051ba7d7a927e8 Command failed on smithi049 with status 1: 'sudo yum -y install ceph-test' [6999161] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:08:39 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999161/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999161/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11b2501b8ff7402d8221c039d5dbee36 Command failed on smithi182 with status 1: 'sudo yum -y install ceph-test' [6999164] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 00:07:49 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999164/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999164/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6f962c5888d4447187e308a269e51929 Command failed on smithi124 with status 1: 'sudo yum -y install ceph-test' [6999166] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999166/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999166/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25ee094aee0d455ba6c771b5b6e3d1f9 Command failed on smithi105 with status 1: 'sudo yum -y install ceph-test' [6999171] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:20 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999171/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999171/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b3a145b9007470d946e2df9910328ba Command failed on smithi043 with status 1: 'sudo yum -y install ceph-test' [6999173] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:08:09 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999173/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999173/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6c2fdf116f2f49c8aaa94230b25b7864 Command failed on smithi079 with status 1: 'sudo yum -y install ceph-test' [6999176] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999176/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999176/ sentry: https://sentry.ceph.com/organizations/ceph/?query=305aced195c049c4b0c5c0ca5d889100 Command failed on smithi189 with status 1: 'sudo yum -y install ceph-test' [6999177] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:08:21 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999177/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999177/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b15f0c3887d1485689ca9b7d973f269d Command failed on smithi096 with status 1: 'sudo yum -y install ceph-test' [6999179] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:58 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999179/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999179/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c9bdb6bf07049b1b4207451de6573ea Command failed on smithi057 with status 1: 'sudo yum -y install ceph-test' [6999181] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999181/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999181/ sentry: https://sentry.ceph.com/organizations/ceph/?query=638c1a0a1db945dcb623a9fb2188e5b3 Command failed on smithi167 with status 1: 'sudo yum -y install ceph-test' [6999183] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:07:45 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999183/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999183/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b15d58c7510d4f05aa1a30c3c1a67d35 Command failed on smithi008 with status 1: 'sudo yum -y install ceph-test' [6999185] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:08:20 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999185/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999185/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2278779af5ad4cfea711090d29edf2d2 Command failed on smithi109 with status 1: 'sudo yum -y install ceph-test' [6999186] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:08:15 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999186/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999186/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f906b449210d4bc3afe4a43466fd799c Command failed on smithi103 with status 1: 'sudo yum -y install ceph-test' [6999187] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:08:29 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999187/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999187/ sentry: https://sentry.ceph.com/organizations/ceph/?query=88bd4454c441406a89ab048629f9a931 Command failed on smithi115 with status 1: 'sudo yum -y install ceph-test' [6999188] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999188/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999188/ sentry: https://sentry.ceph.com/organizations/ceph/?query=815187e2bed94fdc8ca4860a23d96c03 Command failed on smithi088 with status 1: 'sudo yum -y install ceph-test' [6999189] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_striper} ----------------------------------------------------------------- time: 00:07:27 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999189/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a88bc274422747f9b484755f1774a681 Command failed on smithi033 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' [6999190] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:17 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999190/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999190/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d9a55d7e4364819a8292b41883da55e Command failed on smithi049 with status 1: 'sudo yum -y install ceph-test' [6999192] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999192/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999192/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f834f6206cd0456ea7853104a8248e9e Command failed on smithi201 with status 1: 'sudo yum -y install ceph-test' [6999193] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:06 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999193/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999193/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b4119ac6e234794952efddb55ada283 Command failed on smithi105 with status 1: 'sudo yum -y install ceph-test' [6999194] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999194/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999194/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2b5ebf8225ca4af7828d828f7fc2dcf8 Command failed on smithi174 with status 1: 'sudo yum -y install ceph-test' [6999195] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:08:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999195/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999195/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cf7e8facabca40d18158f8972d1aaabb Command failed on smithi079 with status 1: 'sudo yum -y install ceph-test' [6999197] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:47 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999197/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999197/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e92ebb16933c4d15afd5805b5061f412 Command failed on smithi197 with status 1: 'sudo yum -y install ceph-test' [6999198] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999198/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999198/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0b3968c6f104e5fb89c91a70df84b18 Command failed on smithi080 with status 1: 'sudo yum -y install ceph-test' [6999202] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:06:42 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999202/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999202/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b34b88b9d7cc4bffb8969fc8fc21723d Command failed on smithi189 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [6999203] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 00:08:19 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999203/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999203/ sentry: https://sentry.ceph.com/organizations/ceph/?query=929c2ec2f7b048ef9697560420cc08c0 Command failed on smithi081 with status 1: 'sudo yum -y install ceph-test' [6999204] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:08:01 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999204/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999204/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8cd1aacc77a848688e3b00ef1046215c Command failed on smithi130 with status 1: 'sudo yum -y install ceph-test' [6999205] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:07:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999205/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999205/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b092556c010740629e2154589e8bf6b3 Command failed on smithi149 with status 1: 'sudo yum -y install ceph-test' [6999208] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:08:10 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999208/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999208/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6119b08e1cc4499ba038a02eaa0df114 Command failed on smithi027 with status 1: 'sudo yum -y install ceph-test' [6999209] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} ----------------------------------------------------------------- time: 00:08:07 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999209/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999209/ sentry: https://sentry.ceph.com/organizations/ceph/?query=194274f0de524f42b1252013146b137a Command failed on smithi109 with status 1: 'sudo yum -y install ceph-test' [6999210] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999210/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e599aed738f44f3da232ed4bd6ee56e3 Command failed on smithi136 with status 1: 'sudo yum -y install ceph-test' [6999211] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:48 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999211/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999211/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2a2a7a9c5b284942bd75764709df6129 Command failed on smithi044 with status 1: 'sudo yum -y install ceph-test' [6999213] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:25 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999213/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999213/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c2ef6e527a044f7906f44188ae63e6e Command failed on smithi103 with status 1: 'sudo yum -y install ceph-test' [6999215] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999215/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999215/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24e36899905f4ab4afd76f4d9b302d8d Command failed on smithi153 with status 1: 'sudo yum -y install ceph-test' [6999216] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:07:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999216/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999216/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1d0afa171a4343ddbd7d79be04d191b4 Command failed on smithi088 with status 1: 'sudo yum -y install ceph-test' [6999218] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:21 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999218/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999218/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1115802f11c648fdbd9b7ee5ec287e1d Command failed on smithi152 with status 1: 'sudo yum -y install ceph-test' [6999219] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} ----------------------------------------------------------------- time: 00:07:37 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999219/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999219/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9527decb477947baa3500bc1ee4d817b Command failed on smithi094 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' [6999222] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:07:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999222/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999222/ sentry: https://sentry.ceph.com/organizations/ceph/?query=67b74cdf3d224ac6b392b8daf837205a Command failed on smithi174 with status 1: 'sudo yum -y install ceph-test' [6999223] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:08 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999223/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a31ff8d30b24a5ca5cd30229eb03d44 Command failed on smithi145 with status 1: 'sudo yum -y install ceph-test' [6999224] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:07:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999224/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999224/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8371124927b9466dbccfe0a6d5914572 Command failed on smithi105 with status 1: 'sudo yum -y install ceph-test' [6999225] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:07:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999225/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999225/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c7be444ad7884b53b5320f641b995c5f Command failed on smithi165 with status 1: 'sudo yum -y install ceph-test' [6999227] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/insights} ----------------------------------------------------------------- time: 00:08:12 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999227/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999227/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7e8b624c3919452ba65154bbe0226196 Command failed on smithi178 with status 1: 'sudo yum -y install ceph-test' [6999228] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} ----------------------------------------------------------------- time: 00:08:16 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999228/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999228/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed3b216f5e24489c8cfb14e65217d6ec Command failed on smithi125 with status 1: 'sudo yum -y install ceph-test' [6999229] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999229/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999229/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4cb957cf535e4893982a2702522ededb Command failed on smithi080 with status 1: 'sudo yum -y install ceph-test' [6999232] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999232/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999232/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e010cfe078e64eda87298725fed358c5 Command failed on smithi188 with status 1: 'sudo yum -y install ceph-test' [6999233] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} ----------------------------------------------------------------- time: 00:07:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999233/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999233/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e9f5be3a41c4a51814daf1b95aef18b Command failed on smithi090 with status 1: 'sudo yum -y install ceph-test' [6999234] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:16:18 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999234/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999234/ sentry: https://sentry.ceph.com/organizations/ceph/?query=318c878936c5430593f05aaad45e810d Command failed on smithi081 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:1f3c7824d5711a6cd8456a7d17938077a32980ce shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 25b3e4a2-2815-11ed-8431-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [6999236] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:07:36 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999236/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999236/ sentry: https://sentry.ceph.com/organizations/ceph/?query=275ee9e2b3d54b89998f2b2f3ba726af Command failed on smithi109 with status 1: 'sudo yum -y install ceph-test' [6999239] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999239/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999239/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bc1a5ef069c14488b048282a1523bc86 Command failed on smithi017 with status 1: 'sudo yum -y install ceph-test' [6999242] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999242/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999242/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0eec0507c71443b3a3c9a01176950168 Command failed on smithi103 with status 1: 'sudo yum -y install ceph-test' [6999243] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999243/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999243/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f3202af370a2484db1440d5b484a952d Command failed on smithi077 with status 1: 'sudo yum -y install ceph-test' [6999244] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} ----------------------------------------------------------------- time: 00:08:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999244/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999244/ sentry: https://sentry.ceph.com/organizations/ceph/?query=221a4af6530a4b7292028cbeb306cdcb Command failed on smithi106 with status 1: 'sudo yum -y install ceph-test' [6999247] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:16 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999247/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999247/ sentry: https://sentry.ceph.com/organizations/ceph/?query=de112d9bf5244670835471e3f6e7099b Command failed on smithi152 with status 1: 'sudo yum -y install ceph-test' [6999249] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:22:14 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999249/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999249/ sentry: https://sentry.ceph.com/organizations/ceph/?query=def387b425e74049ab1904b64657cfc9 Command failed on smithi154 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 648ef4ae-2816-11ed-8431-001a4aab830c -e sha1=1f3c7824d5711a6cd8456a7d17938077a32980ce -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6999251] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:08:15 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999251/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999251/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6225a3010104e5db5d574c32bda41ab Command failed on smithi190 with status 1: 'sudo yum -y install ceph-test' [6999252] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} ----------------------------------------------------------------- time: 00:07:47 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999252/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999252/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07097ec07ad942dcb95be92f49f30c60 Command failed on smithi145 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' [6999253] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:07:59 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999253/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999253/ sentry: https://sentry.ceph.com/organizations/ceph/?query=57ce39bc869247ed87e74c2167ac5bdb Command failed on smithi003 with status 1: 'sudo yum -y install ceph-test' [6999255] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:20 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999255/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999255/ sentry: https://sentry.ceph.com/organizations/ceph/?query=872cc86a3e4543d4b95cf90255393929 Command failed on smithi165 with status 1: 'sudo yum -y install ceph-test' [6999256] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} ----------------------------------------------------------------- time: 00:08:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999256/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999256/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7fdfe6a6320448549661e656b0193539 Command failed on smithi102 with status 1: 'sudo yum -y install ceph-test' [6999257] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:09:10 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999257/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999257/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bfe7f8d137124fe3a6601d6c6e55ba8e Command failed on smithi174 with status 1: 'sudo yum -y install ceph-test' [6999258] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999258/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999258/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92bbfc0c13fb4dcaafe383fd78f2df0c Command failed on smithi131 with status 1: 'sudo yum -y install ceph-test' [6999265] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:07:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999265/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999265/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b70d2c295f204225bbb6d3e90f2b6c4d Command failed on smithi189 with status 1: 'sudo yum -y install ceph-test' [6999266] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:07:44 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999266/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999266/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8e3f48b2fe374b0099d928c23821f37b Command failed on smithi120 with status 1: 'sudo yum -y install ceph-test' [6999267] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/module_selftest} ----------------------------------------------------------------- time: 00:08:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999267/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999267/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b5064e13df848f4bb169965a5f7eb44 Command failed on smithi188 with status 1: 'sudo yum -y install ceph-test' [6999268] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:07:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999268/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999268/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c54ef0f8f9a4b2cabf9bdaf0e8bdaa1 Command failed on smithi090 with status 1: 'sudo yum -y install ceph-test' [6999269] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} ----------------------------------------------------------------- time: 00:07:29 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999269/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d62627a6532c404eba784450b40878d0 Command failed on smithi046 with status 1: 'sudo yum -y install ceph-test' [6999270] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:34 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999270/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999270/ sentry: https://sentry.ceph.com/organizations/ceph/?query=658de8adc71049fb991533d78bc66271 Command failed on smithi027 with status 1: 'sudo yum -y install ceph-test' [6999271] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:11 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999271/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999271/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff1ee42165ed4e21b0156459a17ba025 Command failed on smithi186 with status 1: 'sudo yum -y install ceph-test' [6999275] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} ----------------------------------------------------------------- time: 00:08:21 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999275/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999275/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5201955cefc24e90940ae476e3f1c255 Command failed on smithi059 with status 1: 'sudo yum -y install ceph-test' [6999276] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:08:46 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999276/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999276/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f8084c2d93ce4746ac4f7236b3e1f1a5 Command failed on smithi152 with status 1: 'sudo yum -y install ceph-test' [6999277] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:18 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999277/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999277/ sentry: https://sentry.ceph.com/organizations/ceph/?query=adba4d4f51da480289078065e6d9e0da Command failed on smithi163 with status 1: 'sudo yum -y install ceph-test' [6999280] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:09:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999280/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999280/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aaa223b3d43140c08ca16e8d09d52c05 Command failed on smithi038 with status 1: 'sudo yum -y install ceph-test' [6999282] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:08:47 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999282/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999282/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3af402d645454a4c987e3775f4b09eb7 Command failed on smithi081 with status 1: 'sudo yum -y install ceph-test' [6999283] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:08:05 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999283/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999283/ sentry: https://sentry.ceph.com/organizations/ceph/?query=23859c226a7a4b2381787df41c27da05 Command failed on smithi165 with status 1: 'sudo yum -y install ceph-test' [6999284] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mostlyread} ----------------------------------------------------------------- time: 00:08:03 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999284/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999284/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd852132beb94df9ae59a15ea6e67f3b Command failed on smithi131 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' [6999287] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:09:22 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999287/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999287/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3f4b3a268914d3f9ecdd0c8a327df17 Command failed on smithi160 with status 1: 'sudo yum -y install ceph-test' [6999288] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:02 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999288/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999288/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1740d2dddfe427bb75f2f6d0f474af0 Command failed on smithi178 with status 1: 'sudo yum -y install ceph-test' [6999290] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:09:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999290/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999290/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b894bcc5a3fd4b09959360572ff6d611 Command failed on smithi189 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1f3c7824d5711a6cd8456a7d17938077a32980ce' [6999292] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:08:12 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999292/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999292/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a793b7e210074c7da7ba5c85805797f0 Command failed on smithi124 with status 1: 'sudo yum -y install ceph-test' [6999293] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:08:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999293/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999293/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff9cae5567d54056929607e63255588f Command failed on smithi093 with status 1: 'sudo yum -y install ceph-test' [6999294] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999294/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999294/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad6874471edc4f3c932073c7287dc7a3 Command failed on smithi080 with status 1: 'sudo yum -y install ceph-test' [6999296] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:09:20 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999296/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999296/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c85ce35c6d246f6aefc23ff3da37836 Command failed on smithi047 with status 1: 'sudo yum -y install ceph-test' [6999298] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999298/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999298/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e9ef3c352a434865983b4600215c3bf5 Command failed on smithi002 with status 1: 'sudo yum -y install ceph-test' [6999300] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:07:59 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999300/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999300/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7ebe534b61604418b7e8b8e2ef40e743 Command failed on smithi197 with status 1: 'sudo yum -y install ceph-test' [6999302] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:08:55 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999302/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999302/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8469634896c4cdbab05084a6b837072 Command failed on smithi017 with status 1: 'sudo yum -y install ceph-test' [6999304] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{filestore-xfs} supported-random-distro$/{rhel_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999304/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999304/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ca60d6f0f2b419e84c291194db4e8f2 Command failed on smithi186 with status 1: 'sudo yum -y install ceph-test' [6999305] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999305/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999305/ sentry: https://sentry.ceph.com/organizations/ceph/?query=70489d04eef84389af01cb093b6143ca Command failed on smithi182 with status 1: 'sudo yum -y install ceph-test' [6999308] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:50:42 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999308/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999308/ "2022-08-30T04:18:16.115266+0000 mon.a (mon.0) 28 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log [6999309] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 00:08:29 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999309/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999309/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f898d165616f4685a732a8cd7ded1e36 Command failed on smithi152 with status 1: 'sudo yum -y install ceph-test' [6999310] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:08:59 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999310/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999310/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da5c9215187048e6b93d3d9a88c7fa20 Command failed on smithi130 with status 1: 'sudo yum -y install ceph-test' [6999311] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:08:58 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999311/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999311/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2ede2c09fc94a68ab43fd13d3becce6 Command failed on smithi102 with status 1: 'sudo yum -y install ceph-test' [6999314] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:08:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999314/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999314/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b659252ceaf4a0bac7b8dfd7016b91c Command failed on smithi062 with status 1: 'sudo yum -y install ceph-test' [6999317] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:22:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999317/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999317/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3744911df1d34b29ab3459f79bb98de5 Command failed on smithi012 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 84f75114-281b-11ed-8431-001a4aab830c -e sha1=1f3c7824d5711a6cd8456a7d17938077a32980ce -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6999322] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999322/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999322/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bb19ad7fafc8439784d84389d753904d Command failed on smithi145 with status 1: 'sudo yum -y install ceph-test' [6999323] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:10:23 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999323/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999323/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed8b20adccb5441cbc1583943af58a95 Command failed on smithi167 with status 1: 'sudo yum -y install ceph-test' [6999326] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:08:17 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999326/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999326/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b5398487c340457bbc36cdfd705d431c Command failed on smithi002 with status 1: 'sudo yum -y install ceph-test' [6999328] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:08:17 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999328/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999328/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59d137f661994cbeb67e226286ffd847 Command failed on smithi017 with status 1: 'sudo yum -y install ceph-test' [6999330] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:07:57 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999330/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999330/ sentry: https://sentry.ceph.com/organizations/ceph/?query=74007eb16bb24c31b463bc32298207fa Command failed on smithi190 with status 1: 'sudo yum -y install ceph-test' [6999331] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999331/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999331/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c718f11935564280901fd47b9cbc5a4b Command failed on smithi182 with status 1: 'sudo yum -y install ceph-test' [6999332] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:25 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999332/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999332/ sentry: https://sentry.ceph.com/organizations/ceph/?query=af02302ba90449238567f443b493297e Command failed on smithi131 with status 1: 'sudo yum -y install ceph-test' [6999334] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:08:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999334/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999334/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d22933ebe7cd44e2801eb7cc45cac6f3 Command failed on smithi059 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [6999337] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} ----------------------------------------------------------------- time: 00:09:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999337/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999337/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d7d0a43cf644c31917408587a103bbe Command failed on smithi035 with status 1: 'sudo yum -y install ceph-test' [6999338] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999338/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999338/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c43a2fce56543998cefedba8d9ee1f7 Command failed on smithi152 with status 1: 'sudo yum -y install ceph-test' [6999339] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/redirect} ----------------------------------------------------------------- time: 00:08:05 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999339/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999339/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7c085008ead543cea049c0856eafc615 Command failed on smithi005 with status 1: 'sudo yum -y install ceph-test' [6999341] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:42 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999341/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999341/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc6f43b9055945ee932a170705105581 Command failed on smithi085 with status 1: 'sudo yum -y install ceph-test' [6999347] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:08:15 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999347/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999347/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ae1768eddae4295ba2c41286a07ac31 Command failed on smithi130 with status 1: 'sudo yum -y install ceph-test' [6999350] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:08:08 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999350/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999350/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cdb5e80416e44a7497a251fb6df4c28d Command failed on smithi157 with status 1: 'sudo yum -y install ceph-test' [6999352] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999352/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999352/ sentry: https://sentry.ceph.com/organizations/ceph/?query=74074e0bfcdb4efca2799bff2a9319bc Command failed on smithi170 with status 1: 'sudo yum -y install ceph-test' [6999353] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/prometheus} ----------------------------------------------------------------- time: 00:08:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999353/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999353/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d795766b6c50468cb9042135f9246f2d Command failed on smithi096 with status 1: 'sudo yum -y install ceph-test' [6999354] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:47 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999354/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999354/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2116462cb2ca42358db86716d01ae067 Command failed on smithi027 with status 1: 'sudo yum -y install ceph-test' [6999355] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:08:23 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999355/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999355/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8f1725307544c47bae31b7912bdc9bb Command failed on smithi190 with status 1: 'sudo yum -y install ceph-test' [6999356] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999356/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999356/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9b4b1ea99c124a329d76cca1b0e48cfa Command failed on smithi163 with status 1: 'sudo yum -y install ceph-test' [6999358] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:08:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999358/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999358/ sentry: https://sentry.ceph.com/organizations/ceph/?query=57c0a857a03b4235b7c9d7b6abedd00d Command failed on smithi109 with status 1: 'sudo yum -y install ceph-test' [6999360] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:08:05 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999360/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999360/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77b41720354d4c13ab2da0baca83f0c2 Command failed on smithi083 with status 1: 'sudo yum -y install ceph-test' [6999363] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} ----------------------------------------------------------------- time: 00:09:02 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999363/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999363/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6cdef3ccd1c647ebb5903f2910c3149a Command failed on smithi182 with status 1: 'sudo yum -y install ceph-test' [6999364] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999364/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999364/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8939cede5f09447c87fec7fa28a53a9e Command failed on smithi087 with status 1: 'sudo yum -y install ceph-test' [6999368] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:49 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999368/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999368/ sentry: https://sentry.ceph.com/organizations/ceph/?query=316298221163460fa74ea9b3d4276dd0 Command failed on smithi035 with status 1: 'sudo yum -y install ceph-test' [6999369] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} ----------------------------------------------------------------- time: 00:07:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999369/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999369/ sentry: https://sentry.ceph.com/organizations/ceph/?query=546b3168afbf4f62be8f28ded730bb83 Command failed on smithi103 with status 1: 'sudo yum -y install ceph-test' [6999372] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:27 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999372/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999372/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d4fcdb2b516d42298f1b3096be4f5c33 Command failed on smithi012 with status 1: 'sudo yum -y install ceph-test' [6999375] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999375/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999375/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3975bb99748a4219b06af239279ef9f2 Command failed on smithi038 with status 1: 'sudo yum -y install ceph-test' [6999376] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:44 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999376/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999376/ sentry: https://sentry.ceph.com/organizations/ceph/?query=47105e1b048742c89f8a559f73f0adba Command failed on smithi003 with status 1: 'sudo yum -y install ceph-test' [6999377] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999377/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999377/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4571efda41de41729d8c6866a4432603 Command failed on smithi160 with status 1: 'sudo yum -y install ceph-test' [6999378] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:07:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999378/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999378/ sentry: https://sentry.ceph.com/organizations/ceph/?query=360a17788f0b4d33957e9d8eb6ea9124 Command failed on smithi157 with status 1: 'sudo yum -y install ceph-test' [6999385] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:08:14 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999385/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999385/ sentry: https://sentry.ceph.com/organizations/ceph/?query=23552e464aa14d6aad053850fba0a77a Command failed on smithi105 with status 1: 'sudo yum -y install ceph-test' [6999386] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:07:56 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999386/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999386/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c880c4d578f543518a411f1d52f1719a Command failed on smithi109 with status 1: 'sudo yum -y install ceph-test' [6999387] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:08:15 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999387/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999387/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4a4e6c7fb2b415ca7d386471e23742f Command failed on smithi027 with status 1: 'sudo yum -y install ceph-test' [6999390] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:11 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999390/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999390/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5ac07e5714a1430eb88d7ec42162848a Command failed on smithi083 with status 1: 'sudo yum -y install ceph-test' [6999392] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:07:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999392/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999392/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d467a14e94d144a9a1197aa9ab6de057 Command failed on smithi131 with status 1: 'sudo yum -y install ceph-test' [6999393] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:09:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999393/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999393/ sentry: https://sentry.ceph.com/organizations/ceph/?query=300d4e3e95fa425dafcfa668d726cac9 Command failed on smithi007 with status 1: 'sudo yum -y install ceph-test' [6999394] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/workunits} ----------------------------------------------------------------- time: 00:10:03 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999394/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999394/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5100335b2e6e448b8309d65f6ab0a4d5 Command failed on smithi047 with status 1: 'sudo yum -y install ceph-test' [6999396] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:09:13 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999396/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999396/ sentry: https://sentry.ceph.com/organizations/ceph/?query=68ce70fd81394dc0b385bf1bcd1fae65 Command failed on smithi066 with status 1: 'sudo yum -y install ceph-test' [6999398] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:07:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999398/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999398/ sentry: https://sentry.ceph.com/organizations/ceph/?query=89e06bbeeca943a3954b8e881839c8b3 Command failed on smithi077 with status 1: 'sudo yum -y install ceph-test' [6999401] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:07:59 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999401/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999401/ sentry: https://sentry.ceph.com/organizations/ceph/?query=98ff83f418d34fc985102f46137d5682 Command failed on smithi099 with status 1: 'sudo yum -y install ceph-test' [6999404] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999404/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999404/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5125d9fc03864fe8ab9366e5b8013475 Command failed on smithi178 with status 1: 'sudo yum -y install ceph-test' [6999405] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999405/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999405/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b7125a688a624b82a75101efd25b6cf4 Command failed on smithi197 with status 1: 'sudo yum -y install ceph-test' [6999406] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:42 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999406/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999406/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec416cb083f940b38d0d5558dde9da0c Command failed on smithi167 with status 1: 'sudo yum -y install ceph-test' [6999411] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} ----------------------------------------------------------------- time: 00:08:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999411/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999411/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac0cd5615d614e98a7564b8155762ffd Command failed on smithi027 with status 1: 'sudo yum -y install ceph-test' [6999412] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:07:57 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999412/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999412/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d8fb16b31e34c3ab590e59780b10ad5 Command failed on smithi007 with status 1: 'sudo yum -y install ceph-test' [6999413] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/libcephsqlite} ----------------------------------------------------------------- time: 00:06:56 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999413/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999413/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d6fe63634ebf4c56bdecc07dc50b9fc2 Command failed on smithi133 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' [6999415] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:08:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999415/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999415/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7a17e2ddc7f044c5b5320953de5ee256 Command failed on smithi157 with status 1: 'sudo yum -y install ceph-test' [6999416] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:37 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999416/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999416/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80a1d8a5ca6541c0abc6cb479342a2ab Command failed on smithi070 with status 1: 'sudo yum -y install ceph-test' [6999418] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:42 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999418/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999418/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bad08af65444464f81934f8ee4dffd53 Command failed on smithi044 with status 1: 'sudo yum -y install ceph-test' [6999419] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:08:37 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999419/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999419/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7563d92b61454d159f630cdd7f91ba4d Command failed on smithi094 with status 1: 'sudo yum -y install ceph-test' [6999420] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:55 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999420/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999420/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f444a79caf149db84711170b69f3172 Command failed on smithi083 with status 1: 'sudo yum -y install ceph-test' [6999421] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} ----------------------------------------------------------------- time: 00:08:55 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999421/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999421/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0dbabe5201964b87875af09aa783af59 Command failed on smithi008 with status 1: 'sudo yum -y install ceph-test' [6999423] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999423/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999423/ sentry: https://sentry.ceph.com/organizations/ceph/?query=00d46ad0d62f4ee0b665ab392d6e7a8b Command failed on smithi047 with status 1: 'sudo yum -y install ceph-test' [6999425] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999425/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999425/ sentry: https://sentry.ceph.com/organizations/ceph/?query=20e392291f224750ab09d32a5607a772 Command failed on smithi170 with status 1: 'sudo yum -y install ceph-test' [6999426] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:08:18 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999426/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999426/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9d0460a825a84b0d895b4a7e094f321b Command failed on smithi201 with status 1: 'sudo yum -y install ceph-test' [6999431] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:08:34 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999431/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999431/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c74da090d48423fa4549d4615a061c8 Command failed on smithi197 with status 1: 'sudo yum -y install ceph-test' [6999432] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:08:58 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999432/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999432/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b2f5e9ef575c4883a41e9928cf63ab35 Command failed on smithi087 with status 1: 'sudo yum -y install ceph-test' [6999433] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 00:07:17 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999433/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999433/ sentry: https://sentry.ceph.com/organizations/ceph/?query=958cb4899fde40268fc5464a9a46d500 Command failed on smithi152 with status 1: 'sudo yum -y install ceph-test' [6999434] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999434/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999434/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ef639fd784d742f9aa6d7c60dc948a82 Command failed on smithi062 with status 1: 'sudo yum -y install ceph-test' [6999435] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999435/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999435/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a60c6f25beb1400bae9d650e69b5c254 Command failed on smithi146 with status 1: 'sudo yum -y install ceph-test' [6999439] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:17 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999439/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999439/ sentry: https://sentry.ceph.com/organizations/ceph/?query=03790f558c234cc9910e6395d15b2140 Command failed on smithi136 with status 1: 'sudo yum -y install ceph-test' [6999442] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999442/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999442/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df1d2d67145f47179e7e66f361079609 Command failed on smithi059 with status 1: 'sudo yum -y install ceph-test' [6999444] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:08:25 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999444/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999444/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c4b12fef6c154888a9154fff1b4c5ab8 Command failed on smithi070 with status 1: 'sudo yum -y install ceph-test' [6999445] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:07:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999445/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999445/ sentry: https://sentry.ceph.com/organizations/ceph/?query=373eb9ea5ded48a79ade6068eb65df27 Command failed on smithi005 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd- mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' [6999448] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:32 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999448/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999448/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8183e23ffe34d5087029b95d0690f66 Command failed on smithi057 with status 1: 'sudo yum -y install ceph-test' [6999449] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:07:49 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999449/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999449/ sentry: https://sentry.ceph.com/organizations/ceph/?query=17aeed139a6649d2bf4a4b87e22de8bc Command failed on smithi047 with status 1: 'sudo yum -y install ceph-test' [6999450] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:32 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999450/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999450/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a482157a35a4ed7973b4ca539ecfcc7 Command failed on smithi083 with status 1: 'sudo yum -y install ceph-test' [6999452] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999452/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999452/ sentry: https://sentry.ceph.com/organizations/ceph/?query=921d77786a784bef9149e8ca37b56574 Command failed on smithi107 with status 1: 'sudo yum -y install ceph-test' [6999454] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:08:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999454/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999454/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a928adeaeff941188b7dff8a015c15ad Command failed on smithi145 with status 1: 'sudo yum -y install ceph-test' [6999456] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:22:12 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999456/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999456/ sentry: https://sentry.ceph.com/organizations/ceph/?query=964c592291c840c08ad5b468fd6a2ddb Command failed on smithi189 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 04d2f228-2829-11ed-8431-001a4aab830c -e sha1=1f3c7824d5711a6cd8456a7d17938077a32980ce -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6999460] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:08:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999460/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999460/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fdbfa69c27864c60838fefea2d3c5026 Command failed on smithi096 with status 1: 'sudo yum -y install ceph-test' [6999461] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:07:52 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999461/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999461/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ab4c9900ae74712bb7b2a6e12e3169d Command failed on smithi035 with status 1: 'sudo yum -y install ceph-test' [6999462] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:07:48 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999462/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999462/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4a330f65cc804643ab8c514402d9df30 Command failed on smithi152 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' Dead ================================================================= [6999313] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:05:02 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999313/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999313/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d0192c9492c64d9abe272148281edf87 {'smithi078.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': False, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/autobuild.asc'}, {'_ansible_item_label': 'http://download.ceph.com/keys/release.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': True, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/release.asc', 'msg': 'Failed to download key at http://download.ceph.com/keys/release.asc: Request failed: '}]}} [6999336] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999336/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999336/ sentry: https://sentry.ceph.com/organizations/ceph/?query=28c77b5f8f3e4986bfb14ba8d4fdda02 {'smithi083.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': True, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '}, {'_ansible_item_label': 'http://download.ceph.com/keys/release.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': False, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/release.asc'}]}} [6999382] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:04:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999382/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999382/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c86fed3825f9437faec101330725cf49 {'smithi170.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': 'http://download.ceph.com/keys/autobuild.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': True, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/autobuild.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/autobuild.asc', 'msg': 'Failed to download key at http://download.ceph.com/keys/autobuild.asc: Request failed: '}, {'_ansible_item_label': 'http://download.ceph.com/keys/release.asc', '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'failed': False, 'invocation': {'module_args': {'data': None, 'file': None, 'id': None, 'key': None, 'keyring': None, 'keyserver': None, 'state': 'present', 'url': 'http://download.ceph.com/keys/release.asc', 'validate_certs': True}}, 'item': 'http://download.ceph.com/keys/release.asc'}]}} Pass ================================================================= [6999043] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:50:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999043/ [6999044] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:32:34 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999044/ [6999045] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:21:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999045/ [6999046] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:19:48 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999046/ [6999047] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 05:08:47 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999047/ [6999049] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:11:03 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999049/ [6999050] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:13:30 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999050/ [6999051] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:25:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999051/ [6999052] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:18:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999052/ [6999056] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:42:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999056/ [6999057] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:34:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999057/ [6999059] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:14:49 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999059/ [6999062] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:24:14 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999062/ [6999065] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:41:14 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999065/ [6999067] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:40:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999067/ [6999069] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:17:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999069/ [6999071] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:32:05 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999071/ [6999075] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:30:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999075/ [6999078] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:20:06 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999078/ [6999079] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:11:11 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999079/ [6999082] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:14:48 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999082/ [6999084] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:55:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999084/ [6999086] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:25:21 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999086/ [6999090] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:36 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999090/ [6999093] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999093/ [6999095] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:10:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999095/ [6999096] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999096/ [6999099] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:53:58 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999099/ [6999108] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999108/ [6999112] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999112/ [6999113] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999113/ [6999114] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:08:07 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999114/ [6999115] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:15:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999115/ [6999116] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999116/ [6999118] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:13:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999118/ [6999123] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:26:29 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999123/ [6999124] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:16:16 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999124/ [6999131] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:35:08 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999131/ [6999132] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999132/ [6999133] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:08 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999133/ [6999134] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:18:58 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999134/ [6999135] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:10:15 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999135/ [6999136] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:09 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999136/ [6999140] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:10:23 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999140/ [6999141] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:36:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999141/ [6999143] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:40:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999143/ [6999149] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:15:22 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999149/ [6999153] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:38:32 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999153/ [6999155] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:17:55 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999155/ [6999156] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_stress_watch} time: 00:26:47 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999156/ [6999157] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999157/ [6999158] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:50:32 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999158/ [6999160] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999160/ [6999162] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:30:11 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999162/ [6999163] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:29:00 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999163/ [6999165] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:19 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999165/ [6999167] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999167/ [6999168] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999168/ [6999169] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:52:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999169/ [6999170] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:13:20 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999170/ [6999172] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:24:34 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999172/ [6999174] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:21:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999174/ [6999175] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:08:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999175/ [6999178] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:36:57 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999178/ [6999180] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:28:37 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999180/ [6999182] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999182/ [6999184] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:15:06 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999184/ [6999191] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:42:52 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999191/ [6999196] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:09 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999196/ [6999199] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999199/ [6999200] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:25:17 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999200/ [6999201] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:16:03 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999201/ [6999206] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:53:15 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999206/ [6999207] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:15:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999207/ [6999212] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:16:27 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999212/ [6999214] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999214/ [6999217] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:14:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999217/ [6999220] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:31:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999220/ [6999221] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:13:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999221/ [6999226] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:13 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999226/ [6999230] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999230/ [6999231] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:34:18 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999231/ [6999235] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:09:15 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999235/ [6999237] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:19:00 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999237/ [6999238] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:15:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999238/ [6999240] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:33:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999240/ [6999241] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:17 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999241/ [6999245] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999245/ [6999246] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:24:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999246/ [6999248] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:37:12 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999248/ [6999250] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999250/ [6999254] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:12 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999254/ [6999259] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:17:46 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999259/ [6999260] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:08:31 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999260/ [6999261] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:08:23 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999261/ [6999262] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:19:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999262/ [6999263] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:18 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999263/ [6999264] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999264/ [6999272] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:45:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999272/ [6999273] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:42:10 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999273/ [6999274] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:22:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999274/ [6999278] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:19:21 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999278/ [6999279] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:12:01 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999279/ [6999281] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:43:59 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999281/ [6999285] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:32 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999285/ [6999286] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:23:16 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999286/ [6999289] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:21:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999289/ [6999291] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:24 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999291/ [6999295] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:25 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999295/ [6999297] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:37:32 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999297/ [6999299] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:24:11 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999299/ [6999301] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:08:13 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999301/ [6999303] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:25 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999303/ [6999306] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:01:01 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999306/ [6999307] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:55:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999307/ [6999312] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:16:51 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999312/ [6999315] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:09:14 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999315/ [6999316] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:54:40 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999316/ [6999318] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:13:47 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999318/ [6999319] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:13:27 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999319/ [6999320] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:00 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999320/ [6999321] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:54 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999321/ [6999324] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:17:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999324/ [6999325] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:15:25 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999325/ [6999327] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:16:59 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999327/ [6999329] rados/objectstore/{backends/fusestore supported-random-distro$/{ubuntu_latest}} time: 00:08:22 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999329/ [6999333] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:33:50 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999333/ [6999335] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:41:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999335/ [6999340] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:04 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999340/ [6999342] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:11:42 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999342/ [6999343] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:21:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999343/ [6999344] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999344/ [6999345] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:12:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999345/ [6999346] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:01 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999346/ [6999348] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:17:27 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999348/ [6999349] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:21:09 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999349/ [6999351] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:34:51 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999351/ [6999357] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:17:37 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999357/ [6999359] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:52 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999359/ [6999361] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:39 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999361/ [6999362] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:31:39 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999362/ [6999365] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999365/ [6999366] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999366/ [6999367] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:16:59 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999367/ [6999370] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:08:34 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999370/ [6999371] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:04 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999371/ [6999373] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:13:25 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999373/ [6999374] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:46:09 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999374/ [6999379] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:52:14 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999379/ [6999380] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:11:09 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999380/ [6999381] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:53 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999381/ [6999383] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:22:03 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999383/ [6999384] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:00 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999384/ [6999388] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} time: 01:06:11 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999388/ [6999389] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999389/ [6999391] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999391/ [6999395] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:29 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999395/ [6999397] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:10:11 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999397/ [6999399] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:21:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999399/ [6999400] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:20:33 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999400/ [6999402] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:09 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999402/ [6999403] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:17 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999403/ [6999407] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:10:05 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999407/ [6999408] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:24:19 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999408/ [6999409] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects} time: 00:24:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999409/ [6999410] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:17:34 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999410/ [6999414] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:36:03 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999414/ [6999417] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:16:56 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999417/ [6999422] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:16:30 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999422/ [6999424] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:17:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999424/ [6999427] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:08:51 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999427/ [6999428] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:45:38 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999428/ [6999429] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:10:44 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999429/ [6999430] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:46 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999430/ [6999436] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999436/ [6999437] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/snaps-few-objects} time: 00:27:01 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999437/ [6999438] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:35 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999438/ [6999440] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:41 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999440/ [6999441] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:52:10 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999441/ [6999443] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:24:26 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999443/ [6999446] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:18:51 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999446/ [6999447] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:22:02 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999447/ [6999451] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:26:46 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999451/ [6999453] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:34:58 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999453/ [6999455] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:43:08 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999455/ [6999457] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:17:43 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999457/ [6999458] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:05 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999458/ [6999459] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:22 info: http://pulpito.ceph.com/yuriw-2022-08-30_01:47:15-rados-wip-yuri3-testing-2022-08-29-1404-pacific-distro-default-smithi/6999459/