2022-08-28T07:23:22.556 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-08-28T07:23:22.557 INFO:teuthology.results:subset: '23464/100000' 2022-08-28T07:23:22.558 INFO:teuthology.results:seed: '2450' 2022-08-28T17:47:10.828 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-08-28T17:47:10.861 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-08-28T20:24:23.710 INFO:teuthology.results:Tests finished! gathering results... 2022-08-28T20:24:53.542 INFO:scrape:Found 309 jobs 2022-08-28T20:25:05.273 INFO:scrape:Found 8 distinct failure reasons 2022-08-28T20:25:05.274 INFO:scrape:Failure: Command failed on smithi115 with status 1: 'sudo yum -y install ceph-test' 2022-08-28T20:25:05.274 INFO:scrape:166 jobs 2022-08-28T20:25:05.276 INFO:scrape:suites intersection: [] 2022-08-28T20:25:05.276 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '0-size-min-size-overrides/2-size-2-min-size', '0-size-min-size-overrides/3-size-2-min-size', '0-start', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', '1-install/pacific', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '1-rook', '1-tasks', '2-inject-leak/mon', '2-inject-leak/none', '2-inject-leak/osd', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '2-workload/none', '2-workload/radosbench', '3-final', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'centos_latest}', 'ceph', 'cluster/3-node', 'cluster/{12-osds', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/default/{default', 'd-thrash/none', 'debug/mgr', 'fast/fast', 'fast/normal', 'k8s/1.21', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'net/calico', 'net/host', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/dashboard/{0-single-container-host', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/21', 'rados/multimon/{clusters/3', 'rados/multimon/{clusters/6', 'rados/multimon/{clusters/9', 'rados/objectstore/{backends/alloc-hint', 'rados/objectstore/{backends/ceph_objectstore_tool', 'rados/objectstore/{backends/filejournal', 'rados/objectstore/{backends/fusestore', 'rados/objectstore/{backends/objectcacher-stress', 'rados/objectstore/{backends/objectstore-bluestore-a', 'rados/objectstore/{backends/objectstore-bluestore-b', 'rados/rest/{mgr-restful', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton-nomsgr/{all/balancer', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/crushdiff', 'rados/singleton-nomsgr/{all/export-after-evict', 'rados/singleton-nomsgr/{all/full-tiering', 'rados/singleton-nomsgr/{all/large-omap-object-warnings', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/msgr', 'rados/singleton-nomsgr/{all/multi-backfill-reject', 'rados/singleton-nomsgr/{all/osd_stale_reads', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/admin-socket', 'rados/singleton/{all/backfill-toofull', 'rados/singleton/{all/deduptool', 'rados/singleton/{all/divergent_priors2', 'rados/singleton/{all/dump-stuck', 'rados/singleton/{all/ec-lost-unfound', 'rados/singleton/{all/lost-unfound', 'rados/singleton/{all/lost-unfound-delete', 'rados/singleton/{all/max-pg-per-osd.from-primary', 'rados/singleton/{all/mon-auth-caps', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/mon-config-key-caps', 'rados/singleton/{all/mon-config-keys', 'rados/singleton/{all/osd-backfill', 'rados/singleton/{all/osd-recovery-incomplete', 'rados/singleton/{all/pg-autoscaler', 'rados/singleton/{all/pg-autoscaler-progress-off', 'rados/singleton/{all/radostool', 'rados/singleton/{all/rebuild-mondb', 'rados/singleton/{all/recovery-preemption', 'rados/singleton/{all/test-noautoscale-flag', 'rados/singleton/{all/thrash-eio', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'rados/singleton/{all/watch-notify-same-primary', 'rados/standalone/{supported-random-distro$/{centos_8}', 'rados/standalone/{supported-random-distro$/{rhel_8}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools}', 'rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8}', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'rados_api', 'rados_loadgenbig', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-comp-zlib}', 'random-objectstore$/{bluestore-hybrid}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'random-objectstore$/{bluestore-stupid}', 'random-objectstore$/{filestore-xfs}', 'rbd_import_export', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'rook/1.7.2}', 'rook/master}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'tasks/crash}', 'tasks/dashboard}', 'tasks/e2e}', 'tasks/failover}', 'tasks/insights}', 'tasks/module_selftest}', 'tasks/mon_clock_no_skews}', 'tasks/mon_clock_with_skews}', 'tasks/mon_recovery', 'tasks/mon_recovery}', 'tasks/progress}', 'tasks/prometheus}', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'tasks/workunits}', 'test_rbd_api', 'test_rbd_python}}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/force-sync-many', 'thrashers/many', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/one', 'thrashers/pggrow', 'thrashers/sync', 'thrashers/sync-many', 'thrashosds-health', 'thrashosds-health}', 'three-plus-one}', 'upgrade-sequence', 'validater/lockdep}', 'validater/valgrind}', 'workload/{ec-rados-default', 'workloads/admin_socket_objecter_requests}', 'workloads/cache-agent-big}', 'workloads/cache-agent-small}', 'workloads/cache-pool-snaps}', 'workloads/cache-snaps-balanced}', 'workloads/cache-snaps}', 'workloads/cache}', 'workloads/crush}', 'workloads/dedup-io-mixed}', 'workloads/ec-pool-snaps-few-objects-overwrites}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=3-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects-balanced}', 'workloads/ec-small-objects-fast-read-overwrites}', 'workloads/ec-small-objects-fast-read}', 'workloads/ec-small-objects-overwrites}', 'workloads/ec-snaps-few-objects-overwrites}', 'workloads/mgr}', 'workloads/misc}', 'workloads/mon}', 'workloads/osd}', 'workloads/pool-create-delete}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/rados_mon_workunits}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/redirect_set_object}', 'workloads/redirect}', 'workloads/set-chunks-read}', 'workloads/small-objects-balanced}', 'workloads/small-objects-localized}', 'workloads/small-objects}', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}', 'workloads/write_fadvise_dontneed}'] 2022-08-28T20:25:05.277 INFO:scrape: 2022-08-28T20:25:05.278 INFO:scrape:Failure: Command failed on smithi187 with status 1: 'sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite-devel' 2022-08-28T20:25:05.278 INFO:scrape:9 jobs: ['6996451', '6996840', '6996472', '6996694', '6996647', '6996748', '6996401', '6996522', '6996496'] 2022-08-28T20:25:05.279 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'openstack}', 'rados', 'rados/basic/{ceph'] 2022-08-28T20:25:05.279 INFO:scrape:suites union: ['clusters/{fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/basic/{ceph', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'tasks/libcephsqlite}', 'tasks/rados_api_tests}', 'tasks/rados_cls_all}', 'tasks/rados_python}', 'tasks/rados_stress_watch}', 'tasks/rados_striper}', 'tasks/rados_workunit_loadgen_big}', 'tasks/repair_test}', 'tasks/scrub_test}'] 2022-08-28T20:25:05.279 INFO:scrape: 2022-08-28T20:25:05.280 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=3c61722a41049616476bb8a8755d50e891247caa 2022-08-28T20:25:05.280 INFO:scrape:11 jobs: ['6996698', '6996576', '6996553', '6996512', '6996533', '6996763', '6996442', '6996804', '6996411', '6996460', '6996673'] 2022-08-28T20:25:05.281 INFO:scrape:suites intersection: [] 2022-08-28T20:25:05.281 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{agent/off', 'rados/cephadm/workunits/{agent/on', 'task/test_adoption}', 'task/test_cephadm}', 'task/test_nfs}', 'task/test_orch_cli}'] 2022-08-28T20:25:05.282 INFO:scrape: 2022-08-28T20:25:05.282 INFO:scrape:Failure: {'smithi102.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'err': " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for more information.\n", 'failed': True, 'invocation': {'module_args': {'force': False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme' failed", 'rc': 3}]}} 2022-08-28T20:25:05.282 INFO:scrape:1 jobs: ['6996493'] 2022-08-28T20:25:05.283 INFO:scrape:suites: ['mon_election/connectivity', 'objectstore/bluestore-bitmap', 'openstack', 'rados/perf/{ceph', 'scheduler/dmclock_default_shards', 'settings/optimized', 'ubuntu_latest', 'workloads/fio_4M_rand_write}'] 2022-08-28T20:25:05.283 INFO:scrape: 2022-08-28T20:25:05.284 INFO:scrape:Failure: Command failed on smithi079 with status 1: 'git archive --remote=git://git.ceph.com/ceph.git 3c61722a41049616476bb8a8755d50e891247caa src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm' 2022-08-28T20:25:05.284 INFO:scrape:1 jobs: ['6996504'] 2022-08-28T20:25:05.285 INFO:scrape:suites: ['0-nvme-loop', 'agent/off', 'fixed-2', 'mon_election/connectivity', 'rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8', 'start}'] 2022-08-28T20:25:05.285 INFO:scrape: 2022-08-28T20:25:05.285 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c61722a41049616476bb8a8755d50e891247caa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' 2022-08-28T20:25:05.286 INFO:scrape:2 jobs: ['6996484', '6996629'] 2022-08-28T20:25:05.286 INFO:scrape:suites intersection: ['task/test_cephadm_repos}'] 2022-08-28T20:25:05.287 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{agent/off', 'rados/cephadm/workunits/{agent/on', 'task/test_cephadm_repos}'] 2022-08-28T20:25:05.287 INFO:scrape: 2022-08-28T20:25:05.288 INFO:scrape:Failure: Command failed on smithi007 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' 2022-08-28T20:25:05.288 INFO:scrape:1 jobs: ['6996501'] 2022-08-28T20:25:05.288 INFO:scrape:suites: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '3-final', 'cluster/1-node', 'k8s/1.21', 'net/flannel', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}'] 2022-08-28T20:25:05.289 INFO:scrape: 2022-08-28T20:25:05.289 INFO:scrape:Failure: expected MON_CLOCK_SKEW but got none 2022-08-28T20:25:05.290 INFO:scrape:1 jobs: ['6996690'] 2022-08-28T20:25:05.290 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async', 'no_pools', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/multimon/{clusters/3', 'supported-random-distro$/{ubuntu_latest}', 'tasks/mon_clock_with_skews}'] 2022-08-28T20:25:05.290 INFO:scrape: 2022-08-28T20:25:05.300 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/ failed: 192 dead: 0 running: 0 waiting: 0 queued: 0 passed: 117 Fail ================================================================= [6996401] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996401/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996401/ sentry: https://sentry.ceph.com/organizations/ceph/?query=892c9f44df394ecfa7d8c945501dbf49 Command failed on smithi077 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd- fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite- devel' [6996406] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996406/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996406/ sentry: https://sentry.ceph.com/organizations/ceph/?query=082f894f07114809b0f826da5320deae Command failed on smithi160 with status 1: 'sudo yum -y install ceph-test' [6996407] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:08:48 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996407/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996407/ sentry: https://sentry.ceph.com/organizations/ceph/?query=601542d182984f2bb45c99f6d0c5aff6 Command failed on smithi094 with status 1: 'sudo yum -y install ceph-test' [6996408] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:07:52 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996408/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996408/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b35713664c7c4d5d86853f8492b13da5 Command failed on smithi012 with status 1: 'sudo yum -y install ceph-test' [6996410] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:07:59 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996410/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996410/ sentry: https://sentry.ceph.com/organizations/ceph/?query=041a56ec7216404a98099dc541637cb0 Command failed on smithi107 with status 1: 'sudo yum -y install ceph-test' [6996411] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:05:04 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996411/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996411/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b5392dfb9f574bc39a61f087ba49a2b1 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996412] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} tasks/e2e} ----------------------------------------------------------------- time: 00:08:02 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996412/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996412/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14c4f087c1a54f3680c8d440b15b7087 Command failed on smithi039 with status 1: 'sudo yum -y install ceph-test' [6996414] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996414/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996414/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bdc4448175f0407ab63c864713e7e99f Command failed on smithi143 with status 1: 'sudo yum -y install ceph-test' [6996415] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:21 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996415/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996415/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6c750b9339314d3e844d31b4f903517e Command failed on smithi046 with status 1: 'sudo yum -y install ceph-test' [6996416] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996416/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996416/ sentry: https://sentry.ceph.com/organizations/ceph/?query=958e4d7822fb460db53343badd7d1010 Command failed on smithi080 with status 1: 'sudo yum -y install ceph-test' [6996420] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996420/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996420/ sentry: https://sentry.ceph.com/organizations/ceph/?query=67b89d2e0f034abc89da99b8f5073924 Command failed on smithi186 with status 1: 'sudo yum -y install ceph-test' [6996421] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996421/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996421/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d4eaae2cde94a5bbe1510870d7e0bea Command failed on smithi049 with status 1: 'sudo yum -y install ceph-test' [6996422] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:30 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996422/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996422/ sentry: https://sentry.ceph.com/organizations/ceph/?query=21cede41aa334a8b9c2a1b87037eb024 Command failed on smithi059 with status 1: 'sudo yum -y install ceph-test' [6996423] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:07:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996423/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996423/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9e94fa64703a4ff085eb101a1670b29d Command failed on smithi134 with status 1: 'sudo yum -y install ceph-test' [6996425] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:08:16 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996425/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996425/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8097153c05254ddb9a178959301c7412 Command failed on smithi063 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [6996427] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} ----------------------------------------------------------------- time: 00:07:36 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996427/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996427/ sentry: https://sentry.ceph.com/organizations/ceph/?query=53880a194d1e49c187e25e540b685e44 Command failed on smithi115 with status 1: 'sudo yum -y install ceph-test' [6996429] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 00:08:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996429/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996429/ sentry: https://sentry.ceph.com/organizations/ceph/?query=424efee8deb042e79c9c578e2a3bd5f8 Command failed on smithi103 with status 1: 'sudo yum -y install ceph-test' [6996431] rados/singleton/{all/deduptool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:32 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996431/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996431/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0585483198904226bb900aa6632d80df Command failed on smithi190 with status 1: 'sudo yum -y install ceph-test' [6996432] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:32 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996432/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996432/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0edc33ca0faf4df6935a9682de2a54c2 Command failed on smithi106 with status 1: 'sudo yum -y install ceph-test' [6996433] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:08:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996433/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996433/ sentry: https://sentry.ceph.com/organizations/ceph/?query=13061ff863d741fc8b40527047ce5079 Command failed on smithi120 with status 1: 'sudo yum -y install ceph-test' [6996436] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996436/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996436/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f87d1f5f6c17463aacf442be8a8cf162 Command failed on smithi146 with status 1: 'sudo yum -y install ceph-test' [6996439] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996439/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996439/ sentry: https://sentry.ceph.com/organizations/ceph/?query=35a94e00bc7e4590a2d76165cc99d29b Command failed on smithi105 with status 1: 'sudo yum -y install ceph-test' [6996440] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996440/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996440/ sentry: https://sentry.ceph.com/organizations/ceph/?query=748b018aa2f54419968392f7be6b7ea7 Command failed on smithi044 with status 1: 'sudo yum -y install ceph-test' [6996441] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:07:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996441/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996441/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe2eaf8c5c5d4af9a24755a9eff6ddb1 Command failed on smithi094 with status 1: 'sudo yum -y install ceph-test' [6996442] rados/cephadm/workunits/{agent/on mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:05:16 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996442/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996442/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39fd4913e77e49bd91b6729697b3c873 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996444] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996444/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996444/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61ce6be7696346d0815ff39969725f1d Command failed on smithi083 with status 1: 'sudo yum -y install ceph-test' [6996445] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-agent-big} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996445/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996445/ sentry: https://sentry.ceph.com/organizations/ceph/?query=beaa78f5df644511834b6704b9ba0762 Command failed on smithi107 with status 1: 'sudo yum -y install ceph-test' [6996446] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996446/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996446/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4b7270cc30064d068d12ed333433a692 Command failed on smithi002 with status 1: 'sudo yum -y install ceph-test' [6996448] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:41 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996448/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996448/ sentry: https://sentry.ceph.com/organizations/ceph/?query=229bdef6bc2c462090148c4d596db74d Command failed on smithi043 with status 1: 'sudo yum -y install ceph-test' [6996451] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/rados_python} ----------------------------------------------------------------- time: 00:07:04 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996451/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996451/ sentry: https://sentry.ceph.com/organizations/ceph/?query=29592cd1a0a842d29e1e3cd6a9e04a5f Command failed on smithi187 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd- fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite- devel' [6996452] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery} ----------------------------------------------------------------- time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996452/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996452/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bcb6fe3dc60849ff897b814231aa09b8 Command failed on smithi047 with status 1: 'sudo yum -y install ceph-test' [6996453] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996453/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996453/ sentry: https://sentry.ceph.com/organizations/ceph/?query=94944fa274b2407982ba95a8c8c7c0f6 Command failed on smithi080 with status 1: 'sudo yum -y install ceph-test' [6996454] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:36 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996454/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996454/ sentry: https://sentry.ceph.com/organizations/ceph/?query=577a12dab080438ab82d082efbef3b2f Command failed on smithi046 with status 1: 'sudo yum -y install ceph-test' [6996456] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small} ----------------------------------------------------------------- time: 00:08:30 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996456/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996456/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2778bf4530bd45ee86a85112441bf910 Command failed on smithi188 with status 1: 'sudo yum -y install ceph-test' [6996457] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{centos_8} tasks/failover} ----------------------------------------------------------------- time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996457/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996457/ sentry: https://sentry.ceph.com/organizations/ceph/?query=315367b88d404c58a075c037442fb5bf Command failed on smithi083 with status 1: 'sudo yum -y install ceph-test' [6996458] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:08:25 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996458/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996458/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce5b1882bd7a4e2787053b1d9ce60293 Command failed on smithi099 with status 1: 'sudo yum -y install ceph-test' [6996459] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} ----------------------------------------------------------------- time: 00:07:53 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996459/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996459/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bf0cbc457a964e34aa325f50066e7f44 Command failed on smithi160 with status 1: 'sudo yum -y install ceph-test' [6996460] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:06:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996460/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996460/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25af833fcc38484aa7ffcf1ea3f2c1c3 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996464] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:09:04 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996464/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996464/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6561ce2ba1c4cf2ab7e8a987699f189 Command failed on smithi131 with status 1: 'sudo yum -y install ceph-test' [6996465] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:10:59 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996465/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996465/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f32c99f9188e47d5841971f1c93fd08d Command failed on smithi085 with status 1: 'sudo yum -y install ceph-test' [6996466] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:10:47 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996466/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996466/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b1264d5beeac43818e320d99af97282b Command failed on smithi178 with status 1: 'sudo yum -y install ceph-test' [6996470] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996470/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996470/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b20fde64d1142439c25980d72ca079d Command failed on smithi146 with status 1: 'sudo yum -y install ceph-test' [6996471] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996471/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996471/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c512128a852d4da9bc8cb08c4e811c73 Command failed on smithi143 with status 1: 'sudo yum -y install ceph-test' [6996472] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} ----------------------------------------------------------------- time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996472/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996472/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82d00dbac8f1437580537b7cc432db15 Command failed on smithi120 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd- fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite- devel' [6996474] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} ----------------------------------------------------------------- time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996474/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996474/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5ffbab9b1b404289b15db8a9f91f5168 Command failed on smithi005 with status 1: 'sudo yum -y install ceph-test' [6996475] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996475/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996475/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2c1c4191065c487c97208f9aeac69e44 Command failed on smithi157 with status 1: 'sudo yum -y install ceph-test' [6996476] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps} ----------------------------------------------------------------- time: 00:14:02 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996476/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996476/ sentry: https://sentry.ceph.com/organizations/ceph/?query=977aba86cab44a15a2b7b3154edbcaa9 Command failed on smithi012 with status 1: 'sudo yum -y install ceph-test' [6996478] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996478/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996478/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a1b83e053d354072b474ae5de1eb4236 Command failed on smithi109 with status 1: 'sudo yum -y install ceph-test' [6996479] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:10:55 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996479/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996479/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a40fcc9665b4faaa647ccdc7bbf682a Command failed on smithi059 with status 1: 'sudo yum -y install ceph-test' [6996483] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:13:52 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996483/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996483/ sentry: https://sentry.ceph.com/organizations/ceph/?query=21387c65d7d143918e6b4c36a34bf01c Command failed on smithi088 with status 1: 'sudo yum -y install ceph-test' [6996484] rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996484/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996484/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5219645daed4314b83e241e2d58866c Command failed (workunit test cephadm/test_repos.sh) on smithi087 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c61722a41049616476bb8a8755d50e891247caa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [6996485] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced} ----------------------------------------------------------------- time: 00:14:09 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996485/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996485/ sentry: https://sentry.ceph.com/organizations/ceph/?query=536120286a9c4a2aa1b55f575ba5db98 Command failed on smithi170 with status 1: 'sudo yum -y install ceph-test' [6996486] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:12:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996486/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996486/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9e1656027d0450fb6c8c9af2d7c210d Command failed on smithi115 with status 1: 'sudo yum -y install ceph-test' [6996488] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{centos_8} tasks/insights} ----------------------------------------------------------------- time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996488/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996488/ sentry: https://sentry.ceph.com/organizations/ceph/?query=625e2c31ca2c4c80b8d85bf820c36b7f Command failed on smithi179 with status 1: 'sudo yum -y install ceph-test' [6996490] rados/dashboard/{0-single-container-host debug/mgr mon_election/connectivity random-objectstore$/{bluestore-stupid} tasks/dashboard} ----------------------------------------------------------------- time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996490/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996490/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8f99bb6f8032477795d3f46a49d51575 Command failed on smithi039 with status 1: 'sudo yum -y install ceph-test' [6996492] rados/upgrade/parallel/{0-random-distro$/{centos_8.stream_container_tools} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:13:59 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996492/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996492/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b1b3cd397ebc42e7a7712a486862c6ed Command failed on smithi189 with status 1: 'sudo yum -y install ceph-test' [6996493] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} ----------------------------------------------------------------- time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996493/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996493/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ad78fd476194e03843cb0c52229ddd3 {'smithi102.front.sepia.ceph.com': {'changed': False, 'msg': 'All items completed', 'results': [{'_ansible_item_label': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, '_ansible_no_log': False, 'ansible_loop_var': 'item', 'changed': False, 'err': " /dev/vg_nvme: already exists in filesystem\n Run `vgcreate --help' for more information.\n", 'failed': True, 'invocation': {'module_args': {'force': False, 'pesize': '4', 'pv_options': '', 'pvresize': False, 'pvs': ['/dev/nvme0n1'], 'state': 'present', 'vg': 'vg_nvme', 'vg_options': ''}}, 'item': {'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}, 'msg': "Creating volume group 'vg_nvme' failed", 'rc': 3}]}} [6996494] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:11:33 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996494/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996494/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fad6fd38ae244563aa5f265cd3fde447 Command failed on smithi187 with status 1: 'sudo yum -y install ceph-test' [6996495] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:14:41 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996495/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996495/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0e4508ad31a40cc89212ba60ebbe9c3 Command failed on smithi176 with status 1: 'sudo yum -y install ceph-test' [6996496] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_striper} ----------------------------------------------------------------- time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996496/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996496/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e3d47cbabeac43d7bba875612520d3db Command failed on smithi089 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd- fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite- devel' [6996498] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:16:18 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996498/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996498/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8aab3eaa1bba4429b93276df46c8f853 Command failed on smithi191 with status 1: 'sudo yum -y install ceph-test' [6996499] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996499/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996499/ sentry: https://sentry.ceph.com/organizations/ceph/?query=15f71e48907e439a87e66458f556bb58 Command failed on smithi158 with status 1: 'sudo yum -y install ceph-test' [6996500] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996500/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996500/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e99be170ba004e5696585ea456b157a1 Command failed on smithi006 with status 1: 'sudo yum -y install ceph-test' [6996501] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/flannel rook/1.7.2} ----------------------------------------------------------------- time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996501/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996501/ sentry: https://sentry.ceph.com/organizations/ceph/?query=787d7c0b9e994683a6d74b4e068a2e93 Command failed on smithi007 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' [6996502] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:16:45 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996502/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996502/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24b9f73be0b54c20a4a57e31c19ae046 Command failed on smithi045 with status 1: 'sudo yum -y install ceph-test' [6996504] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:13:31 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996504/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996504/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6863828baa76409795203822608b10f2 Command failed on smithi079 with status 1: 'git archive --remote=git://git.ceph.com/ceph.git 3c61722a41049616476bb8a8755d50e891247caa src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm' [6996506] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache} ----------------------------------------------------------------- time: 00:14:19 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996506/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996506/ sentry: https://sentry.ceph.com/organizations/ceph/?query=29dfde18cb944ca2a652fb097da45323 Command failed on smithi070 with status 1: 'sudo yum -y install ceph-test' [6996508] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:12:03 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996508/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996508/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c4d8f1c33ba5486ca9d73b5c8b4d5bd3 Command failed on smithi084 with status 1: 'sudo yum -y install ceph-test' [6996509] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} ----------------------------------------------------------------- time: 00:12:06 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996509/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996509/ sentry: https://sentry.ceph.com/organizations/ceph/?query=537ebfe23aeb40d5adf924208c4ed839 Command failed on smithi077 with status 1: 'sudo yum -y install ceph-test' [6996510] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:11:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996510/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996510/ sentry: https://sentry.ceph.com/organizations/ceph/?query=227b3d98e23a4a5eb3f3641175f6449b Command failed on smithi035 with status 1: 'sudo yum -y install ceph-test' [6996511] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:09:02 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996511/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996511/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4cd59bc4cc154dc6b2020617d7ffda3c Command failed on smithi083 with status 1: 'sudo yum -y install ceph-test' [6996512] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:05:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996512/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996512/ sentry: https://sentry.ceph.com/organizations/ceph/?query=051bf150bc414ac4be7ad7b3d124a2a4 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996514] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} ----------------------------------------------------------------- time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996514/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996514/ sentry: https://sentry.ceph.com/organizations/ceph/?query=51393be9a95d4c84a359eb1d7c50a86c Command failed on smithi142 with status 1: 'sudo yum -y install ceph-test' [6996515] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:08:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996515/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996515/ sentry: https://sentry.ceph.com/organizations/ceph/?query=714a5ac205684e88858852405c889fa9 Command failed on smithi131 with status 1: 'sudo yum -y install ceph-test' [6996516] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/dedup-io-mixed} ----------------------------------------------------------------- time: 00:08:01 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996516/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996516/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a7b3886672294f35852243dd3f6ea35e Command failed on smithi080 with status 1: 'sudo yum -y install ceph-test' [6996517] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:19 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996517/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996517/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b8a3924e9924ba88797dd28f51a7ddf Command failed on smithi163 with status 1: 'sudo yum -y install ceph-test' [6996521] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:04:23 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996521/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996521/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f8cd38b8d0f74e379e84515a3b9e7b7e Command failed on smithi134 with status 1: 'sudo yum -y install ceph-test' [6996522] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_big} ----------------------------------------------------------------- time: 00:04:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996522/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996522/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b8f6040b492461285b3442f360bb03b Command failed on smithi105 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd- fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite- devel' [6996523] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/module_selftest} ----------------------------------------------------------------- time: 00:04:17 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996523/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996523/ sentry: https://sentry.ceph.com/organizations/ceph/?query=019e95a749974fa59eae1f0b3132fd17 Command failed on smithi164 with status 1: 'sudo yum -y install ceph-test' [6996525] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996525/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996525/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99b17b8678d44fbaa1accd9f44efa19f Command failed on smithi143 with status 1: 'sudo yum -y install ceph-test' [6996531] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:24 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996531/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996531/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c6a16156bb2d4a8f9eff785ff06a4dc4 Command failed on smithi027 with status 1: 'sudo yum -y install ceph-test' [6996532] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:22 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996532/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996532/ sentry: https://sentry.ceph.com/organizations/ceph/?query=907a3082571a42c58534f03ef60f882f Command failed on smithi136 with status 1: 'sudo yum -y install ceph-test' [6996533] rados/cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:04:58 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996533/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996533/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d73980672e6f43a5ba8de3fa2b943c55 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996534] rados/singleton-nomsgr/{all/crushdiff mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:17 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996534/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996534/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad2afa7ac283490ba0c7c1a6a12325a0 Command failed on smithi080 with status 1: 'sudo yum -y install ceph-test' [6996536] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} ----------------------------------------------------------------- time: 00:04:21 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996536/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996536/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a723967e1ad3497a8a912784491cae0d Command failed on smithi158 with status 1: 'sudo yum -y install ceph-test' [6996537] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:05:19 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996537/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996537/ sentry: https://sentry.ceph.com/organizations/ceph/?query=214d0957765b4c0aa81389ef11ae58a5 Command failed on smithi197 with status 1: 'sudo yum -y install ceph-test' [6996539] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:20 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996539/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996539/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6639ab933ea64f1491a07de015941f92 Command failed on smithi112 with status 1: 'sudo yum -y install ceph-test' [6996542] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} ----------------------------------------------------------------- time: 00:04:26 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996542/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996542/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77aa54517a7b48748f9e4888d93258b7 Command failed on smithi145 with status 1: 'sudo yum -y install ceph-test' [6996543] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:15 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996543/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996543/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b22957670fc7435f829d6be56a7931ce Command failed on smithi116 with status 1: 'sudo yum -y install ceph-test' [6996544] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} ----------------------------------------------------------------- time: 00:05:13 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996544/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996544/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a640310518246b6a0b984328d7efa21 Command failed on smithi103 with status 1: 'sudo yum -y install ceph-test' [6996546] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 00:04:33 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996546/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996546/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d673686b8764d8d85d87697f3a44894 Command failed on smithi035 with status 1: 'sudo yum -y install ceph-test' [6996547] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:04:23 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996547/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996547/ sentry: https://sentry.ceph.com/organizations/ceph/?query=be2c59c968fd4c52b6ffc7621af33507 Command failed on smithi107 with status 1: 'sudo yum -y install ceph-test' [6996549] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:22 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996549/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996549/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dd90872bf4364b28a5ca78c76a5f0bb2 Command failed on smithi001 with status 1: 'sudo yum -y install ceph-test' [6996552] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:04:23 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996552/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996552/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6cbcd9495a204b489c7f56dba1ba0298 Command failed on smithi090 with status 1: 'sudo yum -y install ceph-test' [6996553] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:04:49 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996553/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996553/ sentry: https://sentry.ceph.com/organizations/ceph/?query=95e5fa2f6a0f4ccd9c5d80d73dce792b Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996556] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{rhel_8} tasks/progress} ----------------------------------------------------------------- time: 00:05:27 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996556/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996556/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c9c900f99ac34a949a6f3a4c7861ae37 Command failed on smithi176 with status 1: 'sudo yum -y install ceph-test' [6996557] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:31 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996557/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996557/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6a555178adb4cb7bc52ddf02a002d6a Command failed on smithi059 with status 1: 'sudo yum -y install ceph-test' [6996559] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:04:43 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996559/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996559/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0f0cb9ff2b13471b8841089f8c82d060 Command failed on smithi134 with status 1: 'sudo yum -y install ceph-test' [6996561] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:05:44 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996561/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996561/ sentry: https://sentry.ceph.com/organizations/ceph/?query=beab7d329af44f8d9e846753482fae98 Command failed on smithi057 with status 1: 'sudo yum -y install ceph-test' [6996562] rados/objectstore/{backends/objectstore-bluestore-a supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:34 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996562/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996562/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b823695f1d34369a2c69ea359dafb8f Command failed on smithi167 with status 1: 'sudo yum -y install ceph-test' [6996564] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:04:26 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996564/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996564/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46d8e0673fd24951a4a760fb76b61f82 Command failed on smithi178 with status 1: 'sudo yum -y install ceph-test' [6996565] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:24 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996565/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996565/ sentry: https://sentry.ceph.com/organizations/ceph/?query=054bd537c9d643b286b20f89ff6cbcc5 Command failed on smithi066 with status 1: 'sudo yum -y install ceph-test' [6996566] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:05:21 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996566/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996566/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2ea40ce8a5c43aab1d872b614487ba7 Command failed on smithi136 with status 1: 'sudo yum -y install ceph-test' [6996568] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-comp-zlib} tasks/e2e} ----------------------------------------------------------------- time: 00:04:36 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996568/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996568/ sentry: https://sentry.ceph.com/organizations/ceph/?query=abb103543e5e4f81b824afbab27c4e4f Command failed on smithi124 with status 1: 'sudo yum -y install ceph-test' [6996569] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996569/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996569/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46574aa0f32c4b8ea3d293ca770c77f5 Command failed on smithi080 with status 1: 'sudo yum -y install ceph-test' [6996570] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/sync workloads/pool-create-delete} ----------------------------------------------------------------- time: 00:04:23 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996570/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996570/ sentry: https://sentry.ceph.com/organizations/ceph/?query=efd4e432169042ed9bb20d03d5d5190a Command failed on smithi187 with status 1: 'sudo yum -y install ceph-test' [6996573] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} ----------------------------------------------------------------- time: 00:04:25 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996573/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996573/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea0dfec7eb564baab63c4a3dff801133 Command failed on smithi116 with status 1: 'sudo yum -y install ceph-test' [6996575] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996575/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996575/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b3a6047bb844cd4adf2208158c78d14 Command failed on smithi196 with status 1: 'sudo yum -y install ceph-test' [6996576] rados/cephadm/workunits/{agent/on mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:04:57 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996576/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996576/ sentry: https://sentry.ceph.com/organizations/ceph/?query=992fdc09d2e34092b020181392d9bc46 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996577] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:18 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996577/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996577/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e9f3eb4f58c4fde80890400d94ac05a Command failed on smithi103 with status 1: 'sudo yum -y install ceph-test' [6996578] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} ----------------------------------------------------------------- time: 00:05:24 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996578/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996578/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0b10e0538394526bd24bb5a66cf885e Command failed on smithi102 with status 1: 'sudo yum -y install ceph-test' [6996582] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:05:05 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996582/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996582/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e6119be79c6a44ae8313cd5ae79e88e3 Command failed on smithi001 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [6996584] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996584/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996584/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e7f98863bbd48cbbef287daf51346fd Command failed on smithi157 with status 1: 'sudo yum -y install ceph-test' [6996591] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:20 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996591/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996591/ sentry: https://sentry.ceph.com/organizations/ceph/?query=42adfcc2f0f24266aeb9f29fdc9960b7 Command failed on smithi165 with status 1: 'sudo yum -y install ceph-test' [6996593] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:29 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996593/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996593/ sentry: https://sentry.ceph.com/organizations/ceph/?query=adad58f89a45457490c956f97c4ff7ef Command failed on smithi143 with status 1: 'sudo yum -y install ceph-test' [6996595] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic random-objectstore$/{bluestore-low-osd-mem-target} supported-random-distro$/{rhel_8} tasks/prometheus} ----------------------------------------------------------------- time: 00:05:21 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996595/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996595/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b859260b431140b39bf9f0ddcd13fe20 Command failed on smithi130 with status 1: 'sudo yum -y install ceph-test' [6996597] rados/objectstore/{backends/objectstore-bluestore-b supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996597/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996597/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f24e25e89e954c31a51476454d255833 Command failed on smithi179 with status 1: 'sudo yum -y install ceph-test' [6996601] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:05:27 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996601/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996601/ sentry: https://sentry.ceph.com/organizations/ceph/?query=65db87d988134a63b5a191b268ecb0d9 Command failed on smithi085 with status 1: 'sudo yum -y install ceph-test' [6996605] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:05:21 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996605/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996605/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8f36e0fa567144459839aca0ec06d8f5 Command failed on smithi124 with status 1: 'sudo yum -y install ceph-test' [6996607] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:04:24 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996607/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996607/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c1ab136ac5349dd8366ba988f7ee379 Command failed on smithi116 with status 1: 'sudo yum -y install ceph-test' [6996611] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996611/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996611/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92a83786396f4c6caaadf18bfb27f613 Command failed on smithi149 with status 1: 'sudo yum -y install ceph-test' [6996613] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:21 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996613/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996613/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4c2e29cb5ea74ed9abf6b0071d46d4f4 Command failed on smithi017 with status 1: 'sudo yum -y install ceph-test' [6996615] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} ----------------------------------------------------------------- time: 00:05:09 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996615/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996615/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ac298d839ac4524981ff02bd0ba3aca Command failed on smithi201 with status 1: 'sudo yum -y install ceph-test' [6996623] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:17 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996623/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996623/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e908ec5c97224facbdf17671981391c3 Command failed on smithi107 with status 1: 'sudo yum -y install ceph-test' [6996627] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:04:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996627/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996627/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed3bb22375c141cab4abd5ad185a53b0 Command failed on smithi097 with status 1: 'sudo yum -y install ceph-test' [6996629] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:05:39 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996629/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996629/ sentry: https://sentry.ceph.com/organizations/ceph/?query=09f37af3b9e048109730266e0b5754ae Command failed (workunit test cephadm/test_repos.sh) on smithi035 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3c61722a41049616476bb8a8755d50e891247caa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [6996631] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} ----------------------------------------------------------------- time: 00:05:12 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996631/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996631/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2d0b764c0e78483aa0f8e41e05c4ab55 Command failed on smithi187 with status 1: 'sudo yum -y install ceph-test' [6996633] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:04:20 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996633/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996633/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc1a90d09336440b9e21c64eee6507c0 Command failed on smithi116 with status 1: 'sudo yum -y install ceph-test' [6996635] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/pacific backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:04:31 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996635/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996635/ sentry: https://sentry.ceph.com/organizations/ceph/?query=867d0c903be14267abc1ecb54351fbe6 Command failed on smithi178 with status 1: 'sudo yum -y install ceph-test' [6996637] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} ----------------------------------------------------------------- time: 00:04:17 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996637/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996637/ sentry: https://sentry.ceph.com/organizations/ceph/?query=079358ba85af46e48388d1d9150dfec1 Command failed on smithi188 with status 1: 'sudo yum -y install ceph-test' [6996639] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996639/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996639/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6e379c3248f3448eb71320ac31c1e6d4 Command failed on smithi131 with status 1: 'sudo yum -y install ceph-test' [6996645] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:14 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996645/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996645/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f92ce422a68b476ab05e13ede39296ba Command failed on smithi081 with status 1: 'sudo yum -y install ceph-test' [6996647] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/repair_test} ----------------------------------------------------------------- time: 00:03:41 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996647/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996647/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c43a7e72349748d29cc76c6fdc8f3374 Command failed on smithi152 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd- fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite- devel' [6996649] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:04:26 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996649/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996649/ sentry: https://sentry.ceph.com/organizations/ceph/?query=030995b6e3ac46deaa5fdebde8c07ea4 Command failed on smithi164 with status 1: 'sudo yum -y install ceph-test' [6996651] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:05 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996651/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996651/ sentry: https://sentry.ceph.com/organizations/ceph/?query=86b67fc9a32946279124fd3e48f542af Command failed on smithi107 with status 1: 'sudo yum -y install ceph-test' [6996663] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:05:23 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996663/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996663/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f213f9eef6a5479c8dbdd5095d638070 Command failed on smithi124 with status 1: 'sudo yum -y install ceph-test' [6996665] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:05:13 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996665/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996665/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc8e74f50b984a66bafd0f78d557518d Command failed on smithi090 with status 1: 'sudo yum -y install ceph-test' [6996669] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{rhel_8} tasks/workunits} ----------------------------------------------------------------- time: 00:05:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996669/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996669/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5d12d28519c74ad4b1f3c86fe89d79c2 Command failed on smithi120 with status 1: 'sudo yum -y install ceph-test' [6996671] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996671/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996671/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d4ee97d398104db39fb0e2fe41e24c84 Command failed on smithi165 with status 1: 'sudo yum -y install ceph-test' [6996673] rados/cephadm/workunits/{agent/on mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:04:45 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996673/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996673/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d53c703b3b884de388b7fb57d83ccfcf Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996675] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996675/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996675/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9eb24aed984c462ca1631d62ca614ce7 Command failed on smithi079 with status 1: 'sudo yum -y install ceph-test' [6996677] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:16 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996677/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996677/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6a9f05d927ca4f73bf77c5c3cbf90d04 Command failed on smithi003 with status 1: 'sudo yum -y install ceph-test' [6996679] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:05:17 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996679/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996679/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2d74b9c239524196a3d7f53710e88bc0 Command failed on smithi152 with status 1: 'sudo yum -y install ceph-test' [6996683] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects} ----------------------------------------------------------------- time: 00:04:16 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996683/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996683/ sentry: https://sentry.ceph.com/organizations/ceph/?query=81d7cdf83651419bab0f632aee11bbb0 Command failed on smithi012 with status 1: 'sudo yum -y install ceph-test' [6996686] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996686/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996686/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7f5bb64465a6418fb1a13d74d3e42ef1 Command failed on smithi070 with status 1: 'sudo yum -y install ceph-test' [6996688] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996688/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996688/ sentry: https://sentry.ceph.com/organizations/ceph/?query=206f3ef45b994f1785a15066a8741a9a Command failed on smithi124 with status 1: 'sudo yum -y install ceph-test' [6996690] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} ----------------------------------------------------------------- time: 00:05:32 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996690/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996690/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6c76a676b1894c348ca3cf765e2d5cda expected MON_CLOCK_SKEW but got none [6996692] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996692/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996692/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c8537cc2189c41c8aad5a1d2387d1147 Command failed on smithi087 with status 1: 'sudo yum -y install ceph-test' [6996694] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/scrub_test} ----------------------------------------------------------------- time: 00:04:30 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996694/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996694/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2bfa702b42bf4d6ea595287e957c4c09 Command failed on smithi090 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd- fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite- devel' [6996698] rados/cephadm/workunits/{agent/off mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:04:50 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996698/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996698/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f5abc9f6bfbc40cba97ff88c029bf886 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996706] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996706/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996706/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bbc41397309948158672b07178da6bfd Command failed on smithi142 with status 1: 'sudo yum -y install ceph-test' [6996708] rados/dashboard/{0-single-container-host debug/mgr mon_election/classic random-objectstore$/{bluestore-stupid} tasks/dashboard} ----------------------------------------------------------------- time: 00:04:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996708/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996708/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14368ef9187e4d46bab5826d9a42be3d Command failed on smithi097 with status 1: 'sudo yum -y install ceph-test' [6996710] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996710/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996710/ sentry: https://sentry.ceph.com/organizations/ceph/?query=94b8f20b194a4c0596564690bb401f44 Command failed on smithi134 with status 1: 'sudo yum -y install ceph-test' [6996712] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:09 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996712/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996712/ sentry: https://sentry.ceph.com/organizations/ceph/?query=95e085f934784690b9f1e3634506b035 Command failed on smithi182 with status 1: 'sudo yum -y install ceph-test' [6996714] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996714/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996714/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ac17eb1983743499081d04b15af35ea Command failed on smithi167 with status 1: 'sudo yum -y install ceph-test' [6996718] rados/upgrade/parallel/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 0-start 1-tasks mon_election/classic upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} ----------------------------------------------------------------- time: 00:05:20 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996718/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996718/ sentry: https://sentry.ceph.com/organizations/ceph/?query=640cbe0d81204cc0bac3ce58f36e8504 Command failed on smithi149 with status 1: 'sudo yum -y install ceph-test' [6996720] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} ----------------------------------------------------------------- time: 00:04:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996720/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996720/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b4cf5bbf2d840629abc3150106dbfb6 Command failed on smithi124 with status 1: 'sudo yum -y install ceph-test' [6996728] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:04:22 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996728/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996728/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a051a7a1e6b94083ac1366a434d28786 Command failed on smithi112 with status 1: 'sudo yum -y install ceph-test' [6996731] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:04:20 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996731/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996731/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2c0c8494dbd47678ee6646e0bd59dfe Command failed on smithi043 with status 1: 'sudo yum -y install ceph-test' [6996735] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 00:05:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996735/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996735/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad63110a3e9c44b2b36c7df9f6a925ae Command failed on smithi170 with status 1: 'sudo yum -y install ceph-test' [6996740] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic random-objectstore$/{filestore-xfs} supported-random-distro$/{centos_8} tasks/crash} ----------------------------------------------------------------- time: 00:04:13 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996740/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996740/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a7bb78859b14cc7b39220eb974346bf Command failed on smithi167 with status 1: 'sudo yum -y install ceph-test' [6996742] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:04:47 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996742/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996742/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7d324150b2644e7b976c2dc34d7ff64c Command failed on smithi085 with status 1: 'kubectl apply -f https://docs.projectcalico.org/manifests/tigera-operator.yaml' [6996744] rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:04 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996744/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996744/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b28b02ac83ec4de7905024179daf9cef Command failed on smithi176 with status 1: 'sudo yum -y install ceph-test' [6996746] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 00:04:09 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996746/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996746/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f43a9f89bec4eb7846980d9410f2639 Command failed on smithi070 with status 1: 'sudo yum -y install ceph-test' [6996748] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/libcephsqlite} ----------------------------------------------------------------- time: 00:04:29 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996748/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996748/ sentry: https://sentry.ceph.com/organizations/ceph/?query=486c66d77ff446d79afb5d5c0f43a893 Command failed on smithi130 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd- fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite- devel' [6996754] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:05 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996754/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996754/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1ccc726b4c3b4575864e17933bed26ba Command failed on smithi093 with status 1: 'sudo yum -y install ceph-test' [6996756] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:04:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996756/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996756/ sentry: https://sentry.ceph.com/organizations/ceph/?query=98a9bf683fb642d98c4c6e476969f1ed Command failed on smithi078 with status 1: 'sudo yum -y install ceph-test' [6996758] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996758/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996758/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1ea7f6ded724717a43f26089e0d63fb Command failed on smithi119 with status 1: 'sudo yum -y install ceph-test' [6996763] rados/cephadm/workunits/{agent/off mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:04:58 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996763/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996763/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca44f98ed7bd492e9ec4c97debc33cd6 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996767] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} ----------------------------------------------------------------- time: 00:05:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996767/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996767/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4253887a19b946f480b046b5cd470967 Command failed on smithi107 with status 1: 'sudo yum -y install ceph-test' [6996770] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:08 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996770/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996770/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e13b06b028374c71a30bb127941b567e Command failed on smithi182 with status 1: 'sudo yum -y install ceph-test' [6996778] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:21 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996778/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996778/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8a9f67a81b549059d83d007484055bb Command failed on smithi002 with status 1: 'sudo yum -y install ceph-test' [6996780] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996780/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996780/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c44f0c17d584773a1f0391666a6e28b Command failed on smithi130 with status 1: 'sudo yum -y install ceph-test' [6996784] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:19 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996784/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996784/ sentry: https://sentry.ceph.com/organizations/ceph/?query=948f9dc0945c455db656f2c82104d398 Command failed on smithi077 with status 1: 'sudo yum -y install ceph-test' [6996786] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996786/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996786/ sentry: https://sentry.ceph.com/organizations/ceph/?query=719610c0360e48098903290288b2c35f Command failed on smithi097 with status 1: 'sudo yum -y install ceph-test' [6996788] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:04:14 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996788/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996788/ sentry: https://sentry.ceph.com/organizations/ceph/?query=29f05dd93344490db96e9bcd87e9cfd7 Command failed on smithi145 with status 1: 'sudo yum -y install ceph-test' [6996794] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:05:12 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996794/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996794/ sentry: https://sentry.ceph.com/organizations/ceph/?query=537322d276fa46a29aebd31165e87a07 Command failed on smithi119 with status 1: 'sudo yum -y install ceph-test' [6996796] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} ----------------------------------------------------------------- time: 00:05:13 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996796/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996796/ sentry: https://sentry.ceph.com/organizations/ceph/?query=39cf1e4851814f5092af4ef4862edacb Command failed on smithi107 with status 1: 'sudo yum -y install ceph-test' [6996802] rados/singleton-nomsgr/{all/crushdiff mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:03 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996802/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996802/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8de85f7b78324ca8a7bd165e6ac66e02 Command failed on smithi099 with status 1: 'sudo yum -y install ceph-test' [6996804] rados/cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:04:58 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996804/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996804/ sentry: https://sentry.ceph.com/organizations/ceph/?query=436d073852174ecf8a7c095451117d26 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =3c61722a41049616476bb8a8755d50e891247caa [6996806] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:13 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996806/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996806/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe0be44f131f40fabd7fdacb1711adc5 Command failed on smithi120 with status 1: 'sudo yum -y install ceph-test' [6996810] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_workunits} ----------------------------------------------------------------- time: 00:05:13 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996810/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996810/ sentry: https://sentry.ceph.com/organizations/ceph/?query=afc1f67212cc42599ce4709e84ea6665 Command failed on smithi109 with status 1: 'sudo yum -y install ceph-test' [6996814] rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools} 0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:04:25 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996814/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996814/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2b5f8bafeb454488af7426b54beecab2 Command failed on smithi077 with status 1: 'sudo yum -y install ceph-test' [6996816] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} ----------------------------------------------------------------- time: 00:04:19 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996816/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996816/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41a2b55461ba444fb70a72a2e3ab1334 Command failed on smithi191 with status 1: 'sudo yum -y install ceph-test' [6996818] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:17 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996818/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996818/ sentry: https://sentry.ceph.com/organizations/ceph/?query=18807543f16e4e92b6cc090da14eb82a Command failed on smithi142 with status 1: 'sudo yum -y install ceph-test' [6996820] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:05:25 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996820/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996820/ sentry: https://sentry.ceph.com/organizations/ceph/?query=517d7de645a7431e9cff5f5480677e21 Command failed on smithi164 with status 1: 'sudo yum -y install ceph-test' [6996824] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:13 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996824/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996824/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c5769f8f1824804abdaed60d92f7cb2 Command failed on smithi094 with status 1: 'sudo yum -y install ceph-test' [6996826] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:04:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996826/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996826/ sentry: https://sentry.ceph.com/organizations/ceph/?query=986201ac2d8c425ba293fba80d3107f8 Command failed on smithi196 with status 1: 'sudo yum -y install ceph-test' [6996830] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} ----------------------------------------------------------------- time: 00:05:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996830/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996830/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14932b50d6a24c288563e7586fda77c3 Command failed on smithi089 with status 1: 'sudo yum -y install ceph-test' [6996836] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:08 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996836/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996836/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e62c2bc464974cc19ee628ef0d6c37e8 Command failed on smithi163 with status 1: 'sudo yum -y install ceph-test' [6996838] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996838/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996838/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2116c74541c6407a893e71e2813333af Command failed on smithi090 with status 1: 'sudo yum -y install ceph-test' [6996840] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_cls_all} ----------------------------------------------------------------- time: 00:03:33 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996840/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996840/ sentry: https://sentry.ceph.com/organizations/ceph/?query=802988233a1d4eb7aa65f3aef255304c Command failed on smithi096 with status 1: 'sudo yum -y install ceph- radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph- mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph- mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd- fuse rbd-mirror rbd-nbd sqlite-devel sqlite-devel sqlite-devel sqlite- devel' Pass ================================================================= [6996402] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:54 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996402/ [6996403] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996403/ [6996404] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 01:28:58 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996404/ [6996405] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996405/ [6996409] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:08:37 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996409/ [6996413] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:58 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996413/ [6996417] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996417/ [6996418] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:46:22 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996418/ [6996419] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:08:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996419/ [6996424] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity random-objectstore$/{bluestore-bitmap} supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:12:39 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996424/ [6996426] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:20:20 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996426/ [6996428] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:18:57 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996428/ [6996430] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996430/ [6996434] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:34 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996434/ [6996435] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests} time: 00:33:46 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996435/ [6996437] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:10 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996437/ [6996438] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:09:45 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996438/ [6996443] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:23 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996443/ [6996447] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:53 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996447/ [6996449] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996449/ [6996450] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:26:55 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996450/ [6996455] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:26 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996455/ [6996461] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:54:59 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996461/ [6996462] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:40 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996462/ [6996463] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:26:34 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996463/ [6996467] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:35:33 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996467/ [6996468] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:23:54 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996468/ [6996469] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:14:43 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996469/ [6996473] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:35:02 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996473/ [6996477] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:24:29 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996477/ [6996480] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996480/ [6996481] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996481/ [6996482] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996482/ [6996487] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:26:18 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996487/ [6996489] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996489/ [6996491] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:22:02 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996491/ [6996497] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:18:46 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996497/ [6996503] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:12:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996503/ [6996505] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:19:05 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996505/ [6996507] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects} time: 00:37:32 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996507/ [6996513] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:09:52 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996513/ [6996518] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996518/ [6996519] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:19:36 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996519/ [6996520] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:39 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996520/ [6996524] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:22 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996524/ [6996526] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup-io-snaps} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996526/ [6996527] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:23:42 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996527/ [6996528] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:07 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996528/ [6996529] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996529/ [6996530] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:09 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996530/ [6996535] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:24 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996535/ [6996538] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:49 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996538/ [6996540] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:42 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996540/ [6996541] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd-backfill} time: 04:22:31 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996541/ [6996545] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996545/ [6996548] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996548/ [6996550] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:34:31 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996550/ [6996551] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:23 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996551/ [6996554] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:38:04 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996554/ [6996555] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996555/ [6996558] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:35 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996558/ [6996560] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:12 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996560/ [6996563] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:58 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996563/ [6996567] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:25:56 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996567/ [6996571] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996571/ [6996572] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:18:06 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996572/ [6996574] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:46 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996574/ [6996580] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:06:17 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996580/ [6996586] rados/singleton/{all/peer mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:06:37 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996586/ [6996587] rados/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:16:22 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996587/ [6996589] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:10:18 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996589/ [6996599] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996599/ [6996603] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996603/ [6996609] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:15:10 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996609/ [6996617] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996617/ [6996619] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:06:03 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996619/ [6996621] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_5925} time: 00:08:14 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996621/ [6996625] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:05:47 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996625/ [6996641] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 02:29:03 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996641/ [6996643] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996643/ [6996653] rados/objectstore/{backends/objectstore-filestore-memstore supported-random-distro$/{ubuntu_latest}} time: 00:29:33 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996653/ [6996655] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:14:38 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996655/ [6996657] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:38 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996657/ [6996659] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:04 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996659/ [6996661] rados/singleton/{all/random-eio mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:17:17 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996661/ [6996667] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996667/ [6996681] rados/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:22:19 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996681/ [6996696] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:37 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996696/ [6996700] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:08:25 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996700/ [6996702] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 02:51:38 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996702/ [6996704] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996704/ [6996716] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/c2c} time: 00:10:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996716/ [6996722] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996722/ [6996724] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996724/ [6996726] rados/singleton/{all/test-crash mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:07:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996726/ [6996730] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996730/ [6996733] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:34 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996733/ [6996737] rados/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996737/ [6996750] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:10 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996750/ [6996752] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:03 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996752/ [6996759] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:09:09 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996759/ [6996761] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:13:50 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996761/ [6996765] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996765/ [6996772] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996772/ [6996774] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 01:15:34 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996774/ [6996776] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:28 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996776/ [6996782] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:26 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996782/ [6996790] rados/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996790/ [6996792] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996792/ [6996798] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:25:22 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996798/ [6996800] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-comp-lz4} supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:11:31 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996800/ [6996808] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:57 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996808/ [6996812] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:22:20 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996812/ [6996822] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:14:11 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996822/ [6996828] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:19:03 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996828/ [6996832] rados/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:06 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996832/ [6996834] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2022-08-28_07:01:04-rados-quincy-distro-default-smithi/6996834/