2022-05-15T03:33:40.480 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-15T03:33:40.499 INFO:teuthology.results:subset: '29861/99999' 2022-05-15T03:33:40.500 INFO:teuthology.results:seed: '6502' 2022-05-15T06:44:50.307 INFO:root:teuthology version: 1.1.1.dev333+gb018fa01 2022-05-15T06:44:50.326 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-05-15T10:10:14.059 INFO:teuthology.results:Tests finished! gathering results... 2022-05-15T10:10:44.455 INFO:scrape:Found 413 jobs 2022-05-15T10:10:52.985 INFO:scrape:Found 6 distinct failure reasons 2022-05-15T10:10:52.987 INFO:scrape:Failure: Command failed on smithi189 with status 1: 'sudo yum install -y kernel' 2022-05-15T10:10:52.987 INFO:scrape:152 jobs 2022-05-15T10:10:52.989 INFO:scrape:suites intersection: [] 2022-05-15T10:10:52.990 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-install/luminous', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-inject-leak/mon', '2-inject-leak/none', '2-inject-leak/osd', '2-nfs', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '2-services/basic', '2-services/client-keyring', '2-services/mirror', '2-services/nfs', '2-services/nfs-ingress-rgw-user', '2-services/rgw-ingress', '2-thrash', '3-final}', '3-inline/no', '3-inline/yes', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', '3-start-upgrade', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', '3-upgrade-with-workload', '4-final}', '4-verify}', '4-verify}}', '4-wait', '5-upgrade-ls', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'centos_8.stream_container_tools', 'centos_latest}', 'ceph', 'cluster/{12-osds', 'cluster/{fixed-3', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{2-node-mgr}', 'clusters/{fixed-2', 'clusters/{fixed-4', 'clusters/{openstack', 'conf/{client', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/default/{default', 'd-thrash/none', 'debug/mgr', 'distro$/{ubuntu_18.04}', 'distro/centos_8.stream_container_tools', 'fast/fast', 'fast/normal', 'fixed-2', 'mds', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mode/packaged', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'osd}', 'overrides/{pg-warn', 'pool/datapool', 'rados', 'rados/basic/{ceph', 'rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/rbd_iscsi/{base/install', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools}', 'rados/cephadm/smoke/{0-nvme-loop', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/dashboard/{centos_8.stream_container_tools', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/3', 'rados/multimon/{clusters/6', 'rados/objectstore/{backends/alloc-hint', 'rados/objectstore/{backends/fusestore', 'rados/objectstore/{backends/keyvaluedb', 'rados/singleton-nomsgr/{all/ceph-kvstore-tool', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/singleton-nomsgr/{all/msgr', 'rados/singleton/{all/backfill-toofull', 'rados/singleton/{all/ec-inconsistent-hinfo', 'rados/singleton/{all/erasure-code-nonregression', 'rados/singleton/{all/lost-unfound', 'rados/singleton/{all/lost-unfound-delete', 'rados/singleton/{all/mon-config', 'rados/singleton/{all/osd-recovery', 'rados/singleton/{all/pg-autoscaler-progress-off', 'rados/singleton/{all/resolve_stuck_peering', 'rados/singleton/{all/test-crash', 'rados/standalone/{supported-random-distro$/{centos_8}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'random-objectstore$/{bluestore-comp-zlib}', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'roles', 'root}', 'start', 'start}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'task/test_adoption}', 'task/test_cephadm_repos}', 'task/test_cephadm}', 'task/test_e2e}', 'task/test_nfs}', 'task/test_orch_cli}', 'tasks/crash}', 'tasks/dashboard}', 'tasks/insights}', 'tasks/module_selftest}', 'tasks/mon_clock_no_skews}', 'tasks/mon_recovery', 'tasks/mon_recovery}', 'tasks/rados_api_tests', 'tasks/rados_api_tests}', 'tasks/rados_cls_all', 'tasks/rados_python}', 'tasks/rados_stress_watch}', 'tasks/rados_striper}', 'tasks/rados_workunit_loadgen_big}', 'tasks/rados_workunit_loadgen_mostlyread}', 'tasks/workunits}', 'tasks/{0-from/v16.2.4', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/force-sync-many', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashers/sync-many', 'thrashosds-health', 'thrashosds-health}', 'three-plus-one}', 'validater/lockdep}', 'validater/valgrind}', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/cache-agent-big}', 'workloads/cache-pool-snaps}', 'workloads/cache-snaps}', 'workloads/ceph_iscsi}', 'workloads/crush}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=3-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-radosbench}', 'workloads/ec-snaps-few-objects-overwrites}', 'workloads/misc}', 'workloads/pool-create-delete}', 'workloads/rados_5925}', 'workloads/rados_api_tests}', 'workloads/radosbench}', 'workloads/redirect_set_object}', 'workloads/small-objects-balanced}', 'workloads/small-objects}', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects-localized}', 'workloads/snaps-few-objects}'] 2022-05-15T10:10:52.990 INFO:scrape: 2022-05-15T10:10:52.991 INFO:scrape:Failure: Cannot connect to remote host smithi153 2022-05-15T10:10:52.991 INFO:scrape:10 jobs: ['6834196', '6834198', '6834139', '6834239', '6834053', '6834096', '6833958', '6833970', '6834076', '6834193'] 2022-05-15T10:10:52.992 INFO:scrape:suites intersection: [] 2022-05-15T10:10:52.992 INFO:scrape:suites union: ['0-nvme-loop', '1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/nautilus', '1-install/octopus', '1-start', '2-ops/rm-zap-wait}', '2-partial-upgrade/firsthalf', '2-services/rgw', '3-final}', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-pacific', '8-workload/{rbd-python', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'bluestore-bitmap', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'distro/ubuntu_18.04', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/cephadm/osds/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke/{0-nvme-loop', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashers/careful', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'ubuntu_18.04}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2022-05-15T10:10:52.993 INFO:scrape: 2022-05-15T10:10:52.993 INFO:scrape:Failure: 'check osd count' reached maximum tries (90) after waiting for 900 seconds 2022-05-15T10:10:52.993 INFO:scrape:2 jobs: ['6834020', '6834277'] 2022-05-15T10:10:52.994 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '3-final', 'k8s/1.21', 'net/calico', 'rook/1.6.2}'] 2022-05-15T10:10:52.994 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.6.2}'] 2022-05-15T10:10:52.995 INFO:scrape: 2022-05-15T10:10:52.995 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi187.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' 2022-05-15T10:10:52.996 INFO:scrape:2 jobs: ['6834147', '6833888'] 2022-05-15T10:10:52.996 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '2-workload/none', '3-final', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/master}'] 2022-05-15T10:10:52.996 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/master}'] 2022-05-15T10:10:52.997 INFO:scrape: 2022-05-15T10:10:52.997 INFO:scrape:Failure: timeout expired in wait_until_healthy 2022-05-15T10:10:52.998 INFO:scrape:1 jobs: ['6833981'] 2022-05-15T10:10:52.998 INFO:scrape:suites: ['fixed-2', 'mode/root', 'mon_election/classic', 'msgr/async-v1only', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'start', 'tasks/rados_python}'] 2022-05-15T10:10:52.998 INFO:scrape: 2022-05-15T10:10:52.999 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh 2022-05-15T10:10:52.999 INFO:scrape:1 jobs: ['6834238'] 2022-05-15T10:10:53.000 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', '3-scrub-overrides/{default}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/rados_api_tests}'] 2022-05-15T10:10:53.000 INFO:scrape: 2022-05-15T10:10:53.017 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/ failed: 168 dead: 0 running: 0 waiting: 0 queued: 0 passed: 245 Fail ================================================================= [6833876] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/crash} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833876/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833876/ sentry: https://sentry.ceph.com/organizations/ceph/?query=687ff1dd8fcd486f974e1667764d49e9 Command failed on smithi047 with status 1: 'sudo yum install -y kernel' [6833878] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/rados_5925} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833878/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833878/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d24624788e7644118caccde9b5902b57 Command failed on smithi159 with status 1: 'sudo yum install -y kernel' [6833879] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833879/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833879/ sentry: https://sentry.ceph.com/organizations/ceph/?query=62d73dadac8c411b8607b714f86cdcef Command failed on smithi062 with status 1: 'sudo yum install -y kernel' [6833881] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833881/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833881/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2bd21c02bf824314a0da507b1e5cab48 Command failed on smithi006 with status 1: 'sudo yum install -y kernel' [6833884] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833884/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833884/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9e5df1fe18214d4bbc7087941ca600b2 Command failed on smithi101 with status 1: 'sudo yum install -y kernel' [6833886] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833886/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833886/ sentry: https://sentry.ceph.com/organizations/ceph/?query=568b7a1e2c8c49f9925a8b6f9b287e0a Command failed on smithi057 with status 1: 'sudo yum install -y kernel' [6833888] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:07:14 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833888/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833888/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d5a8b3941ec14d3ab8152c8635f89189 [Errno 2] Cannot find file on the remote 'ubuntu@smithi100.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6833897] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833897/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833897/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05bcfc371e8e43b095c24d627e47cd6a Command failed on smithi185 with status 1: 'sudo yum install -y kernel' [6833899] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833899/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833899/ sentry: https://sentry.ceph.com/organizations/ceph/?query=87057b71d0134013938ae2e09a54d7e3 Command failed on smithi115 with status 1: 'sudo yum install -y kernel' [6833900] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833900/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833900/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cfd405dce42f4ca59f3cab44bb54e17b Command failed on smithi183 with status 1: 'sudo yum install -y kernel' [6833905] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833905/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833905/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e76fac1c73844618b0933d63ab68ef68 Command failed on smithi136 with status 1: 'sudo yum install -y kernel' [6833907] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833907/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833907/ sentry: https://sentry.ceph.com/organizations/ceph/?query=52a6b40989804ee3830be52120bd5f60 Command failed on smithi122 with status 1: 'sudo yum install -y kernel' [6833909] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833909/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833909/ sentry: https://sentry.ceph.com/organizations/ceph/?query=475068411291454b9f0046c105ab0297 Command failed on smithi101 with status 1: 'sudo yum install -y kernel' [6833911] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833911/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833911/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1810a86735914e79ab992da45d233b7c Command failed on smithi053 with status 1: 'sudo yum install -y kernel' [6833914] rados/singleton/{all/backfill-toofull mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833914/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833914/ sentry: https://sentry.ceph.com/organizations/ceph/?query=54e79deff9674ea6bedcae3eed512319 Command failed on smithi049 with status 1: 'sudo yum install -y kernel' [6833923] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833923/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833923/ sentry: https://sentry.ceph.com/organizations/ceph/?query=89977b2e620a4b1f8c3d2f03590f36a7 Command failed on smithi122 with status 1: 'sudo yum install -y kernel' [6833927] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833927/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833927/ sentry: https://sentry.ceph.com/organizations/ceph/?query=08a9ed3ef252461fbf9d362b24323680 Command failed on smithi053 with status 1: 'sudo yum install -y kernel' [6833929] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833929/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833929/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3fd0576a95cf411f999407f73cb9970a Command failed on smithi100 with status 1: 'sudo yum install -y kernel' [6833930] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833930/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833930/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c37a34e60cc2418eb3e11e5640012a8d Command failed on smithi049 with status 1: 'sudo yum install -y kernel' [6833931] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_recovery} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833931/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833931/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9fbeb36cbd524026a101d599582ce656 Command failed on smithi204 with status 1: 'sudo yum install -y kernel' [6833933] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833933/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833933/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f6eb9e96f51a45ec8c68f71a87372389 Command failed on smithi039 with status 1: 'sudo yum install -y kernel' [6833934] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833934/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833934/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac810ceaf47a4deeb68b7f6b83d521df Command failed on smithi002 with status 1: 'sudo yum install -y kernel' [6833940] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833940/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833940/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0eb95b35726c4d8cb94d45ed39c7550b Command failed on smithi166 with status 1: 'sudo yum install -y kernel' [6833941] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833941/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833941/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f52a43be4341498d994f01a887a83ef5 Command failed on smithi049 with status 1: 'sudo yum install -y kernel' [6833944] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833944/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833944/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f5dd5d8bd42c44eba6776e09ab3a5d4b Command failed on smithi053 with status 1: 'sudo yum install -y kernel' [6833947] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833947/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833947/ sentry: https://sentry.ceph.com/organizations/ceph/?query=721e6a2ad09a47b596ddb09848bd36d9 Command failed on smithi171 with status 1: 'sudo yum install -y kernel' [6833949] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833949/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833949/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76297d5647fe49048f9c94864a461fae Command failed on smithi039 with status 1: 'sudo yum install -y kernel' [6833950] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833950/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833950/ sentry: https://sentry.ceph.com/organizations/ceph/?query=227d1242efcf49d190a945101a2d6eea Command failed on smithi036 with status 1: 'sudo yum install -y kernel' [6833952] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833952/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833952/ sentry: https://sentry.ceph.com/organizations/ceph/?query=62529bf304cb4d92b71c79343b6b0354 Command failed on smithi111 with status 1: 'sudo yum install -y kernel' [6833953] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833953/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833953/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6422439c2d5d49a5a03b26dad9b19941 Command failed on smithi062 with status 1: 'sudo yum install -y kernel' [6833954] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/insights} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833954/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833954/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ba11900f8194839b8b19221432fa572 Command failed on smithi057 with status 1: 'sudo yum install -y kernel' [6833958] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833958/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833958/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05d15187d7b843bbb5a4e807a89e3868 Cannot connect to remote host smithi135 [6833960] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833960/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833960/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1461e6b0c6a34773a7a9ceb0e5775122 Command failed on smithi049 with status 1: 'sudo yum install -y kernel' [6833964] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833964/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833964/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d0d59ca7fc1d43358622b8956d58b5e5 Command failed on smithi039 with status 1: 'sudo yum install -y kernel' [6833966] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_striper} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833966/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833966/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3386f20939344b29b67358fdb8967403 Command failed on smithi189 with status 1: 'sudo yum install -y kernel' [6833968] rados/singleton/{all/ec-inconsistent-hinfo mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833968/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833968/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6de9489d46af48f88ab4357c40fc5f6b Command failed on smithi062 with status 1: 'sudo yum install -y kernel' [6833969] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833969/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833969/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4c1d88b6c51347c280c24a86f0eea469 Command failed on smithi111 with status 1: 'sudo yum install -y kernel' [6833970] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833970/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833970/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff50ad9c02cb474ea4330892a8de69ae Cannot connect to remote host smithi089 [6833971] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833971/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833971/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7825f16c3b82411a9be8491721a1177d Command failed on smithi057 with status 1: 'sudo yum install -y kernel' [6833974] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833974/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833974/ sentry: https://sentry.ceph.com/organizations/ceph/?query=576080bf4888429a98354c496012063b Command failed on smithi106 with status 1: 'sudo yum install -y kernel' [6833975] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833975/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833975/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3e27cd89e9d74e1198c0e887edc7bbd8 Command failed on smithi148 with status 1: 'sudo yum install -y kernel' [6833977] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833977/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833977/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ce4a645ae4546bd9520321e34acf71c Command failed on smithi092 with status 1: 'sudo yum install -y kernel' [6833980] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833980/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833980/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9922514ac3b648cab793df9c6f758ce0 Command failed on smithi022 with status 1: 'sudo yum install -y kernel' [6833981] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:33:50 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833981/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833981/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe00e7c839e44ea1a613c41fcaf679aa timeout expired in wait_until_healthy [6833984] rados/objectstore/{backends/alloc-hint supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833984/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833984/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9e34cc7c2fe743d48743778e320daeba Command failed on smithi049 with status 1: 'sudo yum install -y kernel' [6833987] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833987/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833987/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec93c441f6154cee8e9634fa14484d8e Command failed on smithi039 with status 1: 'sudo yum install -y kernel' [6833989] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833989/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833989/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8eafe6e3a4ee45109c714eb4885a9226 Command failed on smithi187 with status 1: 'sudo yum install -y kernel' [6833991] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833991/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833991/ sentry: https://sentry.ceph.com/organizations/ceph/?query=24ab0aee238a4959865abe1edf4791e6 Command failed on smithi057 with status 1: 'sudo yum install -y kernel' [6833992] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833992/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833992/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1840738718f743e689a99fe609f84025 Command failed on smithi093 with status 1: 'sudo yum install -y kernel' [6833993] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833993/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833993/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bc8e7745057d42d58556ff4a76ef0b04 Command failed on smithi099 with status 1: 'sudo yum install -y kernel' [6833994] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833994/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833994/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c50c8870fbb74355919cb6dc4a3d7f13 Command failed on smithi064 with status 1: 'sudo yum install -y kernel' [6833996] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833996/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833996/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e1313663c5041638408f1aba51adead Command failed on smithi149 with status 1: 'sudo yum install -y kernel' [6833997] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833997/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833997/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14e4ece2e5bc4531a3077c638da10e7c Command failed on smithi016 with status 1: 'sudo yum install -y kernel' [6833998] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833998/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833998/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d77b35c73c5d41d19244ab23139b4591 Command failed on smithi106 with status 1: 'sudo yum install -y kernel' [6834002] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834002/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834002/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2afde96cb8b24ff9a123f4a51edef910 Command failed on smithi092 with status 1: 'sudo yum install -y kernel' [6834004] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834004/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834004/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1652824dc8944d95aa8a31c05d19fe74 Command failed on smithi186 with status 1: 'sudo yum install -y kernel' [6834005] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834005/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834005/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bb1b16db421a4d61a9c988a3802f8ce6 Command failed on smithi138 with status 1: 'sudo yum install -y kernel' [6834006] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834006/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834006/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3d78c9e1d948477ab92a2b6ec6b049fb Command failed on smithi204 with status 1: 'sudo yum install -y kernel' [6834008] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834008/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834008/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c78484d8da0e439fa9ef79e3eebee59a Command failed on smithi005 with status 1: 'sudo yum install -y kernel' [6834009] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834009/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834009/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa862e4e120a43fbb68a27e67bf04dce Command failed on smithi174 with status 1: 'sudo yum install -y kernel' [6834012] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834012/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834012/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2488fb9f3c7344cbaec7dc7141c99b2e Command failed on smithi017 with status 1: 'sudo yum install -y kernel' [6834013] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834013/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834013/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3468c0578d3a4ab3be7fad648ecb18da Command failed on smithi099 with status 1: 'sudo yum install -y kernel' [6834020] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:27:34 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834020/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834020/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da38b788c1b6486782874d189053a4e9 'check osd count' reached maximum tries (90) after waiting for 900 seconds [6834023] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834023/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834023/ sentry: https://sentry.ceph.com/organizations/ceph/?query=662b85b0d33742ddb6fdb36baa3c67f2 Command failed on smithi138 with status 1: 'sudo yum install -y kernel' [6834025] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834025/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834025/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80e65878b76b4eb382993f077b10c6dd Command failed on smithi174 with status 1: 'sudo yum install -y kernel' [6834030] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834030/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834030/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e94f54ced394f58b20827d10859f79f Command failed on smithi142 with status 1: 'sudo yum install -y kernel' [6834031] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834031/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834031/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c13c3f32996844a0b99a71c08ce540ee Command failed on smithi136 with status 1: 'sudo yum install -y kernel' [6834035] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834035/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834035/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ba42fd9efd849d097929a95c24aa9f5 Command failed on smithi163 with status 1: 'sudo yum install -y kernel' [6834037] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834037/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834037/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79ca3a54661f4ad9b00494108a075b34 Command failed on smithi178 with status 1: 'sudo yum install -y kernel' [6834038] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834038/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834038/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fbb4840116d34a72b259d6789b6eaba8 Command failed on smithi146 with status 1: 'sudo yum install -y kernel' [6834044] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834044/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834044/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6389fbeca0bc415a9c300f7b3b432bbb Command failed on smithi105 with status 1: 'sudo yum install -y kernel' [6834052] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834052/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834052/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f8a540cf62e4739987668dcfd88301b Command failed on smithi104 with status 1: 'sudo yum install -y kernel' [6834053] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834053/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834053/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91358097e35d43f18409199badb0fa99 Cannot connect to remote host smithi111 [6834055] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834055/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834055/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2f247550056c48c1b7eb9ca60d2d3a96 Command failed on smithi157 with status 1: 'sudo yum install -y kernel' [6834058] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834058/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834058/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f9d72ab90653449fb7e4cd21d78f75bb Command failed on smithi047 with status 1: 'sudo yum install -y kernel' [6834062] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mostlyread} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834062/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834062/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3fa03ef8b8de47ef97c768c8ac64a227 Command failed on smithi150 with status 1: 'sudo yum install -y kernel' [6834067] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834067/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834067/ sentry: https://sentry.ceph.com/organizations/ceph/?query=73343ff042ed46afb6ebd2397b84975c Command failed on smithi186 with status 1: 'sudo yum install -y kernel' [6834070] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834070/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834070/ sentry: https://sentry.ceph.com/organizations/ceph/?query=65b7f1593f704498ac4f598ec7fc50f7 Command failed on smithi115 with status 1: 'sudo yum install -y kernel' [6834071] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834071/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834071/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ece1171de6f4056a7a90b99e33f774a Command failed on smithi047 with status 1: 'sudo yum install -y kernel' [6834072] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834072/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=182a5a135a72469cbb5097052184234b Command failed on smithi151 with status 1: 'sudo yum install -y kernel' [6834073] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834073/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834073/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3bcc3a728a924b0f90b6742398bebccb Command failed on smithi129 with status 1: 'sudo yum install -y kernel' [6834076] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834076/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834076/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0d698c61d6e4cf8a1ab4dcc317982b0 Cannot connect to remote host smithi092 [6834077] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834077/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834077/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b1c09ccebe44a52a38f20ee0874927b Command failed on smithi187 with status 1: 'sudo yum install -y kernel' [6834078] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834078/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834078/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec6d4bfacf1a4f8bacb9ffe1197c491a Command failed on smithi092 with status 1: 'sudo yum install -y kernel' [6834081] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834081/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834081/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0cfba706185d4d418da25168eaae6a21 Command failed on smithi050 with status 1: 'sudo yum install -y kernel' [6834082] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/sync-many workloads/pool-create-delete} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834082/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834082/ sentry: https://sentry.ceph.com/organizations/ceph/?query=16f8e3e912094698b6b0bd5429e3fdcb Command failed on smithi125 with status 1: 'sudo yum install -y kernel' [6834084] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834084/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834084/ sentry: https://sentry.ceph.com/organizations/ceph/?query=97c5e817ee894cbe9f798a5080ffd7b5 Command failed on smithi196 with status 1: 'sudo yum install -y kernel' [6834086] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834086/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834086/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e7d4c70e797b49c19c69c500f72698b9 Command failed on smithi082 with status 1: 'sudo yum install -y kernel' [6834087] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834087/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834087/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b67bbc4416714432a151c961f3d26c52 Command failed on smithi071 with status 1: 'sudo yum install -y kernel' [6834088] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834088/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834088/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dad0c4855599438e94e74a3188ba42ac Command failed on smithi066 with status 1: 'sudo yum install -y kernel' [6834089] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834089/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834089/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ded740fc590142f998e39a69edd5109a Command failed on smithi039 with status 1: 'sudo yum install -y kernel' [6834090] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834090/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834090/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca9b8f3e927749a0b3e356847940756b Command failed on smithi053 with status 1: 'sudo yum install -y kernel' [6834096] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834096/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834096/ sentry: https://sentry.ceph.com/organizations/ceph/?query=608e1e75cbde4ac18118b3823d95ae24 Cannot connect to remote host smithi125 [6834097] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834097/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834097/ sentry: https://sentry.ceph.com/organizations/ceph/?query=319d7b27a7824874aa8d7e9e735c114a Command failed on smithi153 with status 1: 'sudo yum install -y kernel' [6834100] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834100/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=49e5359872ef4d1c825a5bbcd404a162 Command failed on smithi006 with status 1: 'sudo yum install -y kernel' [6834102] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834102/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834102/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85a33609940c483eb65358cfb9b38dee Command failed on smithi196 with status 1: 'sudo yum install -y kernel' [6834103] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834103/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834103/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3965db129da84cb09dcec1b6c66ad42d Command failed on smithi103 with status 1: 'sudo yum install -y kernel' [6834109] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834109/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834109/ sentry: https://sentry.ceph.com/organizations/ceph/?query=927ed0fba7ac4f0b8078d4c3802f6a2e Command failed on smithi066 with status 1: 'sudo yum install -y kernel' [6834111] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834111/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834111/ sentry: https://sentry.ceph.com/organizations/ceph/?query=28c9fa55db6543989d6e357bc9d5a70e Command failed on smithi185 with status 1: 'sudo yum install -y kernel' [6834112] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834112/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834112/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0391aff9f22c4573bd1edd2d1cf692c0 Command failed on smithi139 with status 1: 'sudo yum install -y kernel' [6834114] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834114/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834114/ sentry: https://sentry.ceph.com/organizations/ceph/?query=520996bfc57c43c3887a2ec4b0b657fb Command failed on smithi039 with status 1: 'sudo yum install -y kernel' [6834118] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834118/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834118/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce3d3ad261dd4b4ba4b1ceaa1f3a36f7 Command failed on smithi153 with status 1: 'sudo yum install -y kernel' [6834119] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834119/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834119/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ded816308b1b4e0da7008f8ed6e5855f Command failed on smithi120 with status 1: 'sudo yum install -y kernel' [6834120] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834120/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834120/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea8c8241d4954eaa919c1c173cd5b388 Command failed on smithi006 with status 1: 'sudo yum install -y kernel' [6834121] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/workunits} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834121/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834121/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a0e88a45aab40838dc4ea178cfed4d9 Command failed on smithi159 with status 1: 'sudo yum install -y kernel' [6834123] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834123/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834123/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5cf9d08b65234647be9c8c33b8d740fd Command failed on smithi196 with status 1: 'sudo yum install -y kernel' [6834126] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834126/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834126/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6222318a9d074e51af8293631f690134 Command failed on smithi105 with status 1: 'sudo yum install -y kernel' [6834129] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834129/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834129/ sentry: https://sentry.ceph.com/organizations/ceph/?query=baf24d4f529d46d0b56802bf27127f2d Command failed on smithi093 with status 1: 'sudo yum install -y kernel' [6834131] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834131/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834131/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c1f75c1644d84109aca07bdbaaa68212 Command failed on smithi185 with status 1: 'sudo yum install -y kernel' [6834134] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834134/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834134/ sentry: https://sentry.ceph.com/organizations/ceph/?query=88b08b0722ef415f93f3f0b0e29bb24a Command failed on smithi039 with status 1: 'sudo yum install -y kernel' [6834136] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834136/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834136/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e9da7b7bf22f4427800ba4810c4f9ebb Command failed on smithi106 with status 1: 'sudo yum install -y kernel' [6834137] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834137/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834137/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85ec4bf8734c4c3c9a5beb5db1079eed Command failed on smithi183 with status 1: 'sudo yum install -y kernel' [6834139] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834139/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834139/ sentry: https://sentry.ceph.com/organizations/ceph/?query=794c9c055aa24268b32c63dcfc7863f3 Cannot connect to remote host smithi153 [6834140] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834140/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834140/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25cf3a0e2b054fbba31acce9d7f1cfaf Command failed on smithi052 with status 1: 'sudo yum install -y kernel' [6834147] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:13 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834147/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834147/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff8c81ee4f0a40d7ae85575acfc96be2 [Errno 2] Cannot find file on the remote 'ubuntu@smithi187.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6834148] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834148/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834148/ sentry: https://sentry.ceph.com/organizations/ceph/?query=77b450832117481697bb2edb0e556ba9 Command failed on smithi148 with status 1: 'sudo yum install -y kernel' [6834151] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834151/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834151/ sentry: https://sentry.ceph.com/organizations/ceph/?query=abcd13d2a2f14793b22c66223b205321 Command failed on smithi032 with status 1: 'sudo yum install -y kernel' [6834152] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834152/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834152/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4135b7355567462a900eec63219db2a5 Command failed on smithi185 with status 1: 'sudo yum install -y kernel' [6834153] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834153/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834153/ sentry: https://sentry.ceph.com/organizations/ceph/?query=030702e1ce1548c48b88ce44ab4816f6 Command failed on smithi150 with status 1: 'sudo yum install -y kernel' [6834158] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834158/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834158/ sentry: https://sentry.ceph.com/organizations/ceph/?query=764e48e32008461588e162e42f6fe557 Command failed on smithi146 with status 1: 'sudo yum install -y kernel' [6834160] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/crash} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834160/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834160/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cae520cd1795437182e2bea6f4974087 Command failed on smithi002 with status 1: 'sudo yum install -y kernel' [6834164] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834164/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834164/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e9ba38a7617e416ab02560f2ac8f2bb8 Command failed on smithi063 with status 1: 'sudo yum install -y kernel' [6834165] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834165/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834165/ sentry: https://sentry.ceph.com/organizations/ceph/?query=17cda84e90814aa7b4a450d4992fe5f3 Command failed on smithi019 with status 1: 'sudo yum install -y kernel' [6834166] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834166/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834166/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5aacf3449ab744deb46e9736704728f4 Command failed on smithi109 with status 1: 'sudo yum install -y kernel' [6834169] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834169/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834169/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4efcc2da1f6f4a68a019e48aeda630a2 Command failed on smithi191 with status 1: 'sudo yum install -y kernel' [6834170] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834170/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834170/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0ff48b74026f47d5b7ac95df328bff57 Command failed on smithi167 with status 1: 'sudo yum install -y kernel' [6834178] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834178/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834178/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4259a862b614920b351a3d1f4149107 Command failed on smithi135 with status 1: 'sudo yum install -y kernel' [6834187] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834187/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834187/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2fe23a1f81ea41a2a04aa24114cb9d01 Command failed on smithi109 with status 1: 'sudo yum install -y kernel' [6834189] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834189/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d0ae4b84ac584f88bc5f0fbfa65cff4e Command failed on smithi142 with status 1: 'sudo yum install -y kernel' [6834192] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834192/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834192/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8013a5739b744da4821792c35b0de44c Command failed on smithi050 with status 1: 'sudo yum install -y kernel' [6834193] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834193/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834193/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae2097b087df4aa4987e9ba7ebed4065 Cannot connect to remote host smithi178 [6834194] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-zlib} supported-random-distro$/{centos_8} tasks/dashboard} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834194/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834194/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f8f0b72d3be3491f84d56c39a796d62f Command failed on smithi159 with status 1: 'sudo yum install -y kernel' [6834196] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834196/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834196/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c7b54c56bfd94631b960122c1c4429ad Cannot connect to remote host smithi153 [6834197] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834197/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834197/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ce77c0b8a6c47da88c91648fc232d08 Command failed on smithi187 with status 1: 'sudo yum install -y kernel' [6834198] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834198/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834198/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f786993bc4e14f82a48da0dc71e0330d Cannot connect to remote host smithi190 [6834199] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834199/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834199/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b973c89ccfa14e62b5db51b4cf63e503 Command failed on smithi109 with status 1: 'sudo yum install -y kernel' [6834201] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834201/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834201/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e531903fe1c14219935164378bf774b3 Command failed on smithi105 with status 1: 'sudo yum install -y kernel' [6834203] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834203/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834203/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7eb8f272695d46f99196f4c03e3a8516 Command failed on smithi122 with status 1: 'sudo yum install -y kernel' [6834209] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834209/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834209/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2fb4722ed2644f0291bef8216065217c Command failed on smithi114 with status 1: 'sudo yum install -y kernel' [6834212] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834212/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834212/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6a2713e7be44440ebaae23dc680c642d Command failed on smithi109 with status 1: 'sudo yum install -y kernel' [6834213] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834213/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834213/ sentry: https://sentry.ceph.com/organizations/ceph/?query=23e85f9ee2034a45a99b1815da9c0895 Command failed on smithi105 with status 1: 'sudo yum install -y kernel' [6834214] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834214/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834214/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0d2433960e994e4d8ad3f596aee3a35c Command failed on smithi125 with status 1: 'sudo yum install -y kernel' [6834216] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834216/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834216/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fea5737cc737445da7873d7d160c10e3 Command failed on smithi196 with status 1: 'sudo yum install -y kernel' [6834219] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834219/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834219/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4cac309832774f0087a9e17a6de32d7e Command failed on smithi079 with status 1: 'sudo yum install -y kernel' [6834223] rados/singleton/{all/test-crash mon_election/classic msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834223/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d546b921d12464fbdb9b18b8dcc6c4e Command failed on smithi057 with status 1: 'sudo yum install -y kernel' [6834227] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834227/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834227/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6aa282cb74724f58bb46755a162df170 Command failed on smithi066 with status 1: 'sudo yum install -y kernel' [6834229] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834229/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834229/ sentry: https://sentry.ceph.com/organizations/ceph/?query=68bc87b114ed47598d56b40ff2eef2ed Command failed on smithi047 with status 1: 'sudo yum install -y kernel' [6834230] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834230/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=252f655926bd4bc6ae0782d378d2c32e Command failed on smithi105 with status 1: 'sudo yum install -y kernel' [6834231] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834231/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834231/ sentry: https://sentry.ceph.com/organizations/ceph/?query=63d2b01953d04a2c9ddd3582ebf87873 Command failed on smithi136 with status 1: 'sudo yum install -y kernel' [6834235] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834235/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834235/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1abb1abce603470e92449410982b1726 Command failed on smithi086 with status 1: 'sudo yum install -y kernel' [6834237] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834237/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834237/ sentry: https://sentry.ceph.com/organizations/ceph/?query=13bd4265d90a4536b26f5f8796a9fd57 Command failed on smithi153 with status 1: 'sudo yum install -y kernel' [6834238] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 03:26:27 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834238/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834238/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3a9aa5079784bb5a6a6b4cf753105ed Command failed (workunit test rados/test.sh) on smithi171 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0df6ead8b5e8e9b3364cf925ea4ae7eeff639238 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6834239] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834239/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834239/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e326552b47de4e70b05369a26e850d27 Cannot connect to remote host smithi022 [6834240] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834240/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834240/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0fe7de85e1bf47b1b3f96f66db2d7e65 Command failed on smithi188 with status 1: 'sudo yum install -y kernel' [6834250] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834250/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834250/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9436f19b98ab4b3e9aa4def3164b9bd8 Command failed on smithi057 with status 1: 'sudo yum install -y kernel' [6834257] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834257/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834257/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dee5495f927d4a1bba0f895acfda0b71 Command failed on smithi100 with status 1: 'sudo yum install -y kernel' [6834262] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834262/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834262/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3799a59f4eec4c8b8cfb1bd3419acce7 Command failed on smithi186 with status 1: 'sudo yum install -y kernel' [6834263] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834263/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834263/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f51b503f2ef14f8f93cc8e412b045a07 Command failed on smithi131 with status 1: 'sudo yum install -y kernel' [6834266] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834266/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834266/ sentry: https://sentry.ceph.com/organizations/ceph/?query=57526ce99a654e7f86a3d5813e801cdd Command failed on smithi064 with status 1: 'sudo yum install -y kernel' [6834267] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834267/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834267/ sentry: https://sentry.ceph.com/organizations/ceph/?query=36d62256baac4bbb9f382c59b0b7434b Command failed on smithi167 with status 1: 'sudo yum install -y kernel' [6834269] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834269/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b6c588a2a454b8fad860b0044666564 Command failed on smithi131 with status 1: 'sudo yum install -y kernel' [6834274] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834274/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834274/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07e535d332274663919c0f5c0bbc3777 Command failed on smithi138 with status 1: 'sudo yum install -y kernel' [6834275] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834275/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834275/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82262a535bc0441a903a802adebb9650 Command failed on smithi134 with status 1: 'sudo yum install -y kernel' [6834276] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834276/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834276/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ed0be0772174526bfb8c3556e01f01a Command failed on smithi037 with status 1: 'sudo yum install -y kernel' [6834277] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:21:16 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834277/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834277/ sentry: https://sentry.ceph.com/organizations/ceph/?query=10da7ef73e214d1388bd55b2b97169f9 'wait for operator' reached maximum tries (90) after waiting for 900 seconds [6834279] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834279/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834279/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f026e86cdac7437e80b78e7725490071 Command failed on smithi097 with status 1: 'sudo fuser -v /var/lib/dpkg/lock-frontend' [6834283] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834283/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834283/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6550f3819ee4022a4cc6933952bedaf Command failed on smithi122 with status 1: 'sudo yum install -y kernel' [6834287] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/module_selftest} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834287/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834287/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9e07856874e94b7fae9cf1cd8c22cb43 Command failed on smithi204 with status 1: 'sudo yum install -y kernel' Pass ================================================================= [6833875] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:19:49 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833875/ [6833877] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache} time: 00:21:18 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833877/ [6833880] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:09 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833880/ [6833882] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833882/ [6833883] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:37:34 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833883/ [6833885] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:37:05 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833885/ [6833887] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:38:57 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833887/ [6833889] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:38:41 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833889/ [6833890] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:57 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833890/ [6833891] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:29:33 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833891/ [6833892] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:40 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833892/ [6833893] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:07:51 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833893/ [6833894] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:17:42 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833894/ [6833895] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833895/ [6833896] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833896/ [6833898] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:34:44 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833898/ [6833901] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:15:08 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833901/ [6833902] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833902/ [6833903] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:18:19 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833903/ [6833904] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:30:36 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833904/ [6833906] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:19:39 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833906/ [6833908] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:16:37 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833908/ [6833910] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:05 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833910/ [6833912] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:17:19 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833912/ [6833913] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:27:25 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833913/ [6833915] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/failover} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833915/ [6833916] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_api_tests} time: 00:25:34 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833916/ [6833917] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:39:52 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833917/ [6833918] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:35:25 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833918/ [6833919] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833919/ [6833920] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:08:04 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833920/ [6833921] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:41:10 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833921/ [6833922] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:41 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833922/ [6833924] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833924/ [6833925] rados/singleton/{all/deduptool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:07:55 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833925/ [6833926] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:20:35 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833926/ [6833928] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:43:36 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833928/ [6833932] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:50 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833932/ [6833935] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:28:29 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833935/ [6833936] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:32:22 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833936/ [6833937] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833937/ [6833938] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:17:21 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833938/ [6833939] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:17:31 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833939/ [6833942] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}} time: 04:54:29 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833942/ [6833943] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:10 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833943/ [6833945] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:09:02 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833945/ [6833946] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:13:19 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833946/ [6833948] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833948/ [6833951] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:49 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833951/ [6833955] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:09:32 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833955/ [6833956] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:21:29 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833956/ [6833957] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:57:10 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833957/ [6833959] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:11:10 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833959/ [6833961] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:42:56 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833961/ [6833962] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:30:22 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833962/ [6833963] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833963/ [6833965] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:20:30 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833965/ [6833967] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:20:19 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833967/ [6833972] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833972/ [6833973] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:19:35 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833973/ [6833976] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833976/ [6833978] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 01:14:21 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833978/ [6833979] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:10 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833979/ [6833982] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:45:27 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833982/ [6833983] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:23:06 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833983/ [6833985] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}} time: 00:11:51 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833985/ [6833986] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:30:20 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833986/ [6833988] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 02:47:09 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833988/ [6833990] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833990/ [6833995] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833995/ [6833999] rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:25:28 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6833999/ [6834000] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/module_selftest} time: 00:28:21 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834000/ [6834001] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:41 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834001/ [6834003] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_workunits} time: 00:40:21 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834003/ [6834007] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:39:49 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834007/ [6834010] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:07:58 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834010/ [6834011] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:31:41 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834011/ [6834014] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:12:58 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834014/ [6834015] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:35 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834015/ [6834016] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:38 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834016/ [6834017] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/test_rbd_api} time: 00:28:41 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834017/ [6834018] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-balanced} time: 00:32:45 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834018/ [6834019] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:14 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834019/ [6834021] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834021/ [6834022] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:19:52 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834022/ [6834024] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:20:17 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834024/ [6834026] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:12 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834026/ [6834027] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:46:26 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834027/ [6834028] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834028/ [6834029] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:20:51 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834029/ [6834032] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:11:40 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834032/ [6834033] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/cache-snaps} time: 00:40:06 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834033/ [6834034] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834034/ [6834036] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834036/ [6834039] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834039/ [6834040] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/progress} time: 00:18:39 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834040/ [6834041] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:17:41 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834041/ [6834042] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/one workloads/snaps-few-objects} time: 00:47:25 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834042/ [6834043] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834043/ [6834045] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834045/ [6834046] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834046/ [6834047] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:43:29 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834047/ [6834048] rados/standalone/{supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:51:28 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834048/ [6834049] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:54 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834049/ [6834050] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:26 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834050/ [6834051] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834051/ [6834054] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834054/ [6834056] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:20:21 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834056/ [6834057] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:26:34 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834057/ [6834059] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read} time: 00:32:03 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834059/ [6834060] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834060/ [6834061] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:55 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834061/ [6834063] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:30:41 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834063/ [6834064] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:22:38 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834064/ [6834065] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:41:46 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834065/ [6834066] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834066/ [6834068] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834068/ [6834069] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834069/ [6834074] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:16:17 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834074/ [6834075] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:13:09 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834075/ [6834079] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:07:15 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834079/ [6834080] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:23:02 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834080/ [6834083] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:19:50 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834083/ [6834085] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:19:48 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834085/ [6834091] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:12:04 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834091/ [6834092] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834092/ [6834093] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:26:47 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834093/ [6834094] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:38:45 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834094/ [6834095] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:48:20 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834095/ [6834098] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:21:06 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834098/ [6834099] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:11 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834099/ [6834101] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834101/ [6834104] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:33:46 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834104/ [6834105] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:56:39 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834105/ [6834106] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834106/ [6834107] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:16:48 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834107/ [6834108] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:50:39 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834108/ [6834110] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:25:54 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834110/ [6834113] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:47 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834113/ [6834115] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834115/ [6834116] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:28:44 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834116/ [6834117] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:09:15 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834117/ [6834122] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834122/ [6834124] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:19:27 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834124/ [6834125] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:18:39 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834125/ [6834127] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:19:23 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834127/ [6834128] rados/singleton/{all/peer mon_election/connectivity msgr-failures/none msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:07:37 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834128/ [6834130] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:41:08 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834130/ [6834132] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:18:54 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834132/ [6834133] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:32:03 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834133/ [6834135] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:22:54 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834135/ [6834138] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:07:09 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834138/ [6834141] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:20:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834141/ [6834142] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects} time: 00:19:03 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834142/ [6834143] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834143/ [6834144] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:17:32 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834144/ [6834145] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:18:01 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834145/ [6834146] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:25:55 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834146/ [6834149] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834149/ [6834150] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:36:23 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834150/ [6834154] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:11:14 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834154/ [6834155] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:47:35 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834155/ [6834156] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:42 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834156/ [6834157] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:20:40 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834157/ [6834159] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:31:25 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834159/ [6834161] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:30:44 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834161/ [6834162] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-overwrites} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834162/ [6834163] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:39:03 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834163/ [6834167] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:18:53 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834167/ [6834168] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:24:45 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834168/ [6834171] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:24 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834171/ [6834172] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:28:59 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834172/ [6834173] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:33:10 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834173/ [6834174] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834174/ [6834175] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:25 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834175/ [6834176] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:20:16 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834176/ [6834177] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:07:55 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834177/ [6834179] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:27:03 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834179/ [6834180] rados/singleton/{all/random-eio mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:19:38 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834180/ [6834181] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:22:59 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834181/ [6834182] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:23:15 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834182/ [6834183] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:31:57 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834183/ [6834184] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:04 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834184/ [6834185] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:52:46 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834185/ [6834186] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834186/ [6834188] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834188/ [6834190] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:26:30 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834190/ [6834191] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:35:34 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834191/ [6834195] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:30:12 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834195/ [6834200] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 01:06:13 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834200/ [6834202] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834202/ [6834204] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:55:07 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834204/ [6834205] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:08:47 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834205/ [6834206] rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:25:42 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834206/ [6834207] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:07:43 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834207/ [6834208] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834208/ [6834210] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:22:12 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834210/ [6834211] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:43 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834211/ [6834215] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:30:56 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834215/ [6834217] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:29:29 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834217/ [6834218] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834218/ [6834220] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:20:04 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834220/ [6834221] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834221/ [6834222] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834222/ [6834224] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:14:29 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834224/ [6834225] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:30 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834225/ [6834226] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mon} time: 00:54:24 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834226/ [6834228] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:15:26 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834228/ [6834232] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:37:37 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834232/ [6834233] rados/singleton/{all/test-noautoscale-flag mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:07:56 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834233/ [6834234] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:20:13 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834234/ [6834236] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:07:54 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834236/ [6834241] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:15:16 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834241/ [6834242] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:18:52 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834242/ [6834243] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:17:54 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834243/ [6834244] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834244/ [6834245] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:50 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834245/ [6834246] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/rados_mon_workunits} time: 00:28:40 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834246/ [6834247] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:17:48 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834247/ [6834248] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/rados_cls_all} time: 00:20:08 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834248/ [6834249] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 01:06:02 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834249/ [6834251] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:42:05 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834251/ [6834252] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:41:11 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834252/ [6834253] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 01:15:34 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834253/ [6834254] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:17:42 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834254/ [6834255] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:57 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834255/ [6834256] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:39:58 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834256/ [6834258] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834258/ [6834259] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:18:54 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834259/ [6834260] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:27:55 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834260/ [6834261] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:30:32 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834261/ [6834264] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:23:39 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834264/ [6834265] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:08 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834265/ [6834268] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} time: 00:37:41 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834268/ [6834270] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834270/ [6834271] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:08 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834271/ [6834272] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834272/ [6834273] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:31:51 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834273/ [6834278] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:28:56 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834278/ [6834280] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:20:45 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834280/ [6834281] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:24:00 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834281/ [6834282] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:13:57 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834282/ [6834284] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} time: 03:21:02 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834284/ [6834285] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:17:59 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834285/ [6834286] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/none msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:21:57 info: http://pulpito.ceph.com/teuthology-2022-05-15_03:31:03-rados-pacific-distro-default-smithi/6834286/