2022-10-21T22:56:09.359 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-21T22:56:09.362 INFO:teuthology.results:subset: '111/120000' 2022-10-21T22:56:09.362 INFO:teuthology.results:seed: '2348' 2022-10-22T03:09:06.998 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9 2022-10-22T03:09:07.028 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-10-22T05:58:24.970 INFO:teuthology.results:Tests finished! gathering results... 2022-10-22T05:59:02.371 INFO:scrape:Found 426 jobs 2022-10-22T05:59:22.322 INFO:scrape:Found 8 distinct failure reasons 2022-10-22T05:59:22.323 INFO:scrape:Failure: Command failed on smithi133 with status 5: 'sudo systemctl stop ceph-8fff0efa-51a9-11ed-8438-001a4aab830c@mon.a' 2022-10-22T05:59:22.324 INFO:scrape:124 jobs 2022-10-22T05:59:22.325 INFO:scrape:suites intersection: [] 2022-10-22T05:59:22.326 INFO:scrape:suites union: ['0-nvme-loop', '1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', '1-start', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-services/basic', '2-services/client-keyring', '2-services/iscsi', '2-services/mirror', '2-services/nfs', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs2', '2-services/rgw', '2-services/rgw-ingress', '2-thrash', '3-final}', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{2-node-mgr}', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'debug/mgr', 'distro$/{ubuntu_18.04}', 'distro/centos_8.stream_container_tools', 'distro/rhel_8.4_container_tools_3.0', 'distro/rhel_8.4_container_tools_rhel8', 'distro/ubuntu_18.04', 'distro/ubuntu_20.04', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'rados', 'rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/osds/{0-distro/ubuntu_18.04', 'rados/cephadm/osds/{0-distro/ubuntu_20.04', 'rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools}', 'rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8}', 'rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04}', 'rados/cephadm/smoke/{0-nvme-loop', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'rados/cephadm/with-work/{0-distro/ubuntu_18.04', 'rados/cephadm/with-work/{0-distro/ubuntu_20.04', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/dashboard/{centos_8.stream_container_tools', 'random-objectstore$/{bluestore-hybrid}', 'root}', 'start', 'start}', 'supported-random-distro$/{ubuntu_latest}', 'task/test_e2e}', 'task/test_nfs}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'tasks/dashboard}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2022-10-22T05:59:22.327 INFO:scrape: 2022-10-22T05:59:22.327 INFO:scrape:Failure: Command failed on smithi057 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49ff7a3e-51b8-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' 2022-10-22T05:59:22.327 INFO:scrape:30 jobs 2022-10-22T05:59:22.328 INFO:scrape:suites intersection: [] 2022-10-22T05:59:22.329 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '3-upgrade/simple', '3-upgrade/staggered', '4-final}', '4-verify}', '4-verify}}', '4-wait', '5-upgrade-ls', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon_election/classic}', 'mon_election/connectivity}', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9', 'roles', 'tasks/{0-from/v16.2.4'] 2022-10-22T05:59:22.329 INFO:scrape: 2022-10-22T05:59:22.330 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi112 with status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2022-10-22T05:59:22.330 INFO:scrape:4 jobs: ['7076129', '7076233', '7076450', '7076344'] 2022-10-22T05:59:22.331 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-10-22T05:59:22.331 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-10-22T05:59:22.332 INFO:scrape: 2022-10-22T05:59:22.332 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi081.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' 2022-10-22T05:59:22.333 INFO:scrape:2 jobs: ['7076063', '7076332'] 2022-10-22T05:59:22.333 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '3-final', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-10-22T05:59:22.333 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-10-22T05:59:22.334 INFO:scrape: 2022-10-22T05:59:22.334 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' 2022-10-22T05:59:22.335 INFO:scrape:4 jobs: ['7076149', '7076361', '7076037', '7076255'] 2022-10-22T05:59:22.335 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm_repos}'] 2022-10-22T05:59:22.336 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm_repos}'] 2022-10-22T05:59:22.336 INFO:scrape: 2022-10-22T05:59:22.337 INFO:scrape:Failure: Command failed on smithi035 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' 2022-10-22T05:59:22.337 INFO:scrape:2 jobs: ['7076466', '7076198'] 2022-10-22T05:59:22.338 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '2-workload/radosbench', '3-final', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/1.6.2}'] 2022-10-22T05:59:22.338 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_18.04', 'rook/1.6.2}'] 2022-10-22T05:59:22.339 INFO:scrape: 2022-10-22T05:59:22.339 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a 2022-10-22T05:59:22.340 INFO:scrape:2 jobs: ['7076204', '7076418'] 2022-10-22T05:59:22.340 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}'] 2022-10-22T05:59:22.341 INFO:scrape:suites union: ['rados/cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}'] 2022-10-22T05:59:22.341 INFO:scrape: 2022-10-22T05:59:22.342 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh 2022-10-22T05:59:22.342 INFO:scrape:1 jobs: ['7076050'] 2022-10-22T05:59:22.343 INFO:scrape:suites: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-stupid', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{rhel_8}', 'thrashers/sync', 'workloads/rados_mon_osdmap_prune}'] 2022-10-22T05:59:22.343 INFO:scrape: 2022-10-22T05:59:22.359 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/ failed: 169 dead: 0 running: 0 waiting: 0 queued: 0 passed: 257 Fail ================================================================= [7076037] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:44 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076037/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076037/ sentry: https://sentry.ceph.com/organizations/ceph/?query=62184ec297864f89909f1269cf735225 Command failed (workunit test cephadm/test_repos.sh) on smithi071 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7076039] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:06:47 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076039/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076039/ sentry: https://sentry.ceph.com/organizations/ceph/?query=96b1aab996ad4579adda905512c9d0e4 Command failed on smithi080 with status 5: 'sudo systemctl stop ceph-6517123c-5195-11ed-8438-001a4aab830c@mon.a' [7076041] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076041/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076041/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b83b70da32a6494eb9db94ffa89e0805 Command failed on smithi084 with status 5: 'sudo systemctl stop ceph- dde6d4fe-5195-11ed-8438-001a4aab830c@mon.a' [7076045] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:09:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076045/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076045/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab5bb1f6f12f4549b90ee3268fcbbda0 Command failed on smithi172 with status 5: 'sudo systemctl stop ceph-2a995dd0-5196-11ed-8438-001a4aab830c@mon.smithi172' [7076046] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:25:28 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076046/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076046/ sentry: https://sentry.ceph.com/organizations/ceph/?query=449c347489c64f28bfde555c04d99905 Command failed on smithi027 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a08e301a-5196-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076048] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} ----------------------------------------------------------------- time: 00:20:21 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076048/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076048/ sentry: https://sentry.ceph.com/organizations/ceph/?query=21d6341bb5a24c388389cddc2adee915 Command failed on smithi111 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b39b4f26-5196-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076050] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune} ----------------------------------------------------------------- time: 03:16:44 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076050/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076050/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ac697e0d59c4b6b9788f0e6ae9c3c1b Command failed (workunit test mon/test_mon_osdmap_prune.sh) on smithi169 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/mon/test_mon_osdmap_prune.sh' [7076055] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:13:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076055/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076055/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9acd28e291744648b20d835b496a18a4 Command failed on smithi197 with status 5: 'sudo systemctl stop ceph-1eace23e-5197-11ed-8438-001a4aab830c@mon.a' [7076057] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:05:42 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076057/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076057/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32a633a1f169423d89822fc6be4bf092 Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-f8cfa8e4-5196-11ed-8438-001a4aab830c@mon.smithi018' [7076059] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:07:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076059/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076059/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4883711d639a4e5d8daefebdf1d84a24 Command failed on smithi107 with status 5: 'sudo systemctl stop ceph-197d81ec-5197-11ed-8438-001a4aab830c@mon.a' [7076062] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:36 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076062/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076062/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48b84b014a594006be872e0118df4405 Command failed on smithi155 with status 5: 'sudo systemctl stop ceph-3b660522-5197-11ed-8438-001a4aab830c@mon.a' [7076063] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:57 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076063/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076063/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a89da631a56b4fbd92b94316db791d47 [Errno 2] Cannot find file on the remote 'ubuntu@smithi081.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [7076064] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076064/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076064/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80b1234bae6a49d2a7e1bb025cb3c3a1 Command failed on smithi112 with status 5: 'sudo systemctl stop ceph-96f253aa-5197-11ed-8438-001a4aab830c@mon.smithi112' [7076066] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:14:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076066/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076066/ sentry: https://sentry.ceph.com/organizations/ceph/?query=29101c9be60d40eb9b088fccc2cde1d0 Command failed on smithi008 with status 5: 'sudo systemctl stop ceph-f43141c0-5197-11ed-8438-001a4aab830c@mon.a' [7076068] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:12:37 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076068/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076068/ sentry: https://sentry.ceph.com/organizations/ceph/?query=37333b003d4c46a59a1230da9938e6cd Command failed on smithi171 with status 5: 'sudo systemctl stop ceph-7c3bf6dc-5198-11ed-8438-001a4aab830c@mon.a' [7076070] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:13:32 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076070/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076070/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1b1d641206cf48f986bbf0bfeb802ce9 Command failed on smithi157 with status 5: 'sudo systemctl stop ceph-5e60ab76-5198-11ed-8438-001a4aab830c@mon.a' [7076072] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:05:33 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076072/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=809ee82e429f4b20b3ea61642f678d5a Command failed on smithi032 with status 5: 'sudo systemctl stop ceph-d3c11e06-5197-11ed-8438-001a4aab830c@mon.smithi032' [7076074] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:24:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076074/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076074/ sentry: https://sentry.ceph.com/organizations/ceph/?query=739731f648154eb2803a3e2fbadfa0f8 Command failed on smithi057 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 83066e84-5198-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076078] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:06:46 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076078/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076078/ sentry: https://sentry.ceph.com/organizations/ceph/?query=793fc72dec3f468db5ef23ab9a87ff7c Command failed on smithi130 with status 5: 'sudo systemctl stop ceph-d479eade-5198-11ed-8438-001a4aab830c@mon.a' [7076080] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:59 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076080/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076080/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26aaa8077ce940cf920af50d3b3cc142 Command failed on smithi090 with status 5: 'sudo systemctl stop ceph-576aa8b6-5199-11ed-8438-001a4aab830c@mon.a' [7076081] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:14:41 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076081/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076081/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80746a2849804857a0daf59018f0903c Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-78210f8c-5199-11ed-8438-001a4aab830c@mon.a' [7076084] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:11:03 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076084/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076084/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d0137e2ccf24cfabe97f0842f22b7cb Command failed on smithi017 with status 5: 'sudo systemctl stop ceph-21226c4e-5199-11ed-8438-001a4aab830c@mon.smithi017' [7076087] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:06:03 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076087/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076087/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6e0a4ae6fba4ab0a6c5d26eed941165 Command failed on smithi006 with status 5: 'sudo systemctl stop ceph-888313ca-5199-11ed-8438-001a4aab830c@mon.smithi006' [7076088] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-hybrid} supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:05:31 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076088/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076088/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5def1353b8ae476d9b698fb6924ddeb0 Command failed on smithi106 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7076095] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076095/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076095/ sentry: https://sentry.ceph.com/organizations/ceph/?query=715a2508753142ea9e505420f028e025 Command failed on smithi083 with status 5: 'sudo systemctl stop ceph-19aa5782-519a-11ed-8438-001a4aab830c@mon.a' [7076096] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:25:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076096/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076096/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6679d6729e744ecea04a7a2c7e839be7 Command failed on smithi049 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 43e58486-519a-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076100] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:26:06 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076100/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076100/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1bda63fcd3ea4e34a3f591e2456e2306 Command failed on smithi062 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3a6577f4-519a-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076109] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076109/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076109/ sentry: https://sentry.ceph.com/organizations/ceph/?query=916258ed5d4a4ec3a523cf1785270c6a Command failed on smithi040 with status 5: 'sudo systemctl stop ceph-291868e8-519b-11ed-8438-001a4aab830c@mon.a' [7076110] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:10:56 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076110/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076110/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9325553263b548fd9832eee4e5cb92c9 Command failed on smithi012 with status 5: 'sudo systemctl stop ceph-70631de2-519b-11ed-8438-001a4aab830c@mon.smithi012' [7076112] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:08:28 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076112/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076112/ sentry: https://sentry.ceph.com/organizations/ceph/?query=836424cd988a486b90f8870ccb92be04 Command failed on smithi006 with status 5: 'sudo systemctl stop ceph-5b99226c-519b-11ed-8438-001a4aab830c@mon.smithi006' [7076114] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:13:49 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076114/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076114/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c47d1488c28246618f18ddf265061715 Command failed on smithi033 with status 5: 'sudo systemctl stop ceph- ee215b5e-519b-11ed-8438-001a4aab830c@mon.a' [7076117] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} ----------------------------------------------------------------- time: 00:20:47 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076117/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076117/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f3335edf3cca422283a1fc063131bb41 Command failed on smithi134 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9c8d7610-519b-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076119] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:12:16 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076119/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076119/ sentry: https://sentry.ceph.com/organizations/ceph/?query=abe61ebd4f91411da425765933d25d69 Command failed on smithi132 with status 5: 'sudo systemctl stop ceph-797694c6-519c-11ed-8438-001a4aab830c@mon.a' [7076125] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:06:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076125/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076125/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9525fcae08d044de9d4b34e4975f43a8 Command failed on smithi080 with status 5: 'sudo systemctl stop ceph-6a27c184-519c-11ed-8438-001a4aab830c@mon.a' [7076126] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:09:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076126/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076126/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d51ff71e94ea431d909f59694a3ab86b Command failed on smithi057 with status 5: 'sudo systemctl stop ceph-90b97fa4-519c-11ed-8438-001a4aab830c@mon.smithi057' [7076127] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:09:09 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076127/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076127/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9fadd5a26d4348dda5bb246528eadca5 Command failed on smithi005 with status 5: 'sudo systemctl stop ceph- abc4315e-519c-11ed-8438-001a4aab830c@mon.smithi005' [7076129] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:14:08 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076129/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076129/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a409d02275c2402790aea34ef7f71bc7 Command failed (workunit test cephadm/test_cephadm.sh) on smithi112 with status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7076131] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076131/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076131/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cf88505f26a8456b91998b3630d1753d Command failed on smithi079 with status 5: 'sudo systemctl stop ceph-b3dc437c-519c-11ed-8438-001a4aab830c@mon.a' [7076135] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:06:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076135/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076135/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e060462c36594a41b53cd3913aa182d3 Command failed on smithi026 with status 5: 'sudo systemctl stop ceph-29fefbb2-519d-11ed-8438-001a4aab830c@mon.a' [7076136] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:23:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076136/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076136/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1810ba0f193942f6a726fd30d9fca27e Command failed on smithi006 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c99948ee-519d-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076141] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076141/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076141/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a2e3f4d22561489cbed82610624c321a Command failed on smithi157 with status 5: 'sudo systemctl stop ceph-e9368de2-519d-11ed-8438-001a4aab830c@mon.smithi157' [7076144] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:14:24 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076144/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076144/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05ae6630778040ab95316d31fa945323 Command failed on smithi008 with status 5: 'sudo systemctl stop ceph-7a00a97a-519e-11ed-8438-001a4aab830c@mon.a' [7076146] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:07:51 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076146/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076146/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a33ea0f6a99b4b51af7934aab705fd57 Command failed on smithi049 with status 5: 'sudo systemctl stop ceph-630028a4-519e-11ed-8438-001a4aab830c@mon.a' [7076149] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:08:04 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076149/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076149/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a80ac3c4299d4157b4b044a7ff06f939 Command failed (workunit test cephadm/test_repos.sh) on smithi032 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7076150] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:09:21 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076150/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076150/ sentry: https://sentry.ceph.com/organizations/ceph/?query=43b1c01a56a044b2a3b8874e759be43e Command failed on smithi087 with status 5: 'sudo systemctl stop ceph-7b4d3a82-519e-11ed-8438-001a4aab830c@mon.a' [7076153] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:06:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076153/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076153/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85b2174fbb554bc78baa3b07eef88925 Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-46d1da60-519e-11ed-8438-001a4aab830c@mon.smithi018' [7076156] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:07:31 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076156/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076156/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6776969ea1ca486ebf91d632fd751f34 Command failed on smithi057 with status 5: 'sudo systemctl stop ceph-9cdba526-519e-11ed-8438-001a4aab830c@mon.a' [7076158] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:09:08 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076158/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076158/ sentry: https://sentry.ceph.com/organizations/ceph/?query=594a676304704def83bd682ab2f93506 Command failed on smithi079 with status 5: 'sudo systemctl stop ceph-d723ac1a-519e-11ed-8438-001a4aab830c@mon.smithi079' [7076160] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:25:18 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076160/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076160/ sentry: https://sentry.ceph.com/organizations/ceph/?query=57b916dc00f9465e9ee95a76c46a7989 Command failed on smithi062 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 760e9d12-519f-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076161] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} ----------------------------------------------------------------- time: 00:23:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076161/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076161/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f424c87bdd0344aab565baa124f18df9 Command failed on smithi155 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 46bd99be-519f-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\'' [7076164] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:14:18 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076164/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076164/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ece54f83f3ed4c12be6def88199914e4 Command failed on smithi026 with status 5: 'sudo systemctl stop ceph-7b181428-519f-11ed-8438-001a4aab830c@mon.a' [7076167] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:05:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076167/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076167/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f3943c85ce64801b2402cf9663b871c Command failed on smithi163 with status 5: 'sudo systemctl stop ceph-8febbde6-519f-11ed-8438-001a4aab830c@mon.smithi163' [7076169] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076169/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076169/ sentry: https://sentry.ceph.com/organizations/ceph/?query=16ae6cd4e8624bb1851fa6b759715a4e Command failed on smithi035 with status 5: 'sudo systemctl stop ceph-3a33c9fc-519f-11ed-8438-001a4aab830c@mon.a' [7076170] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:06:36 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076170/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076170/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cbcb59cecef044b29086e484b0245eb6 Command failed on smithi121 with status 5: 'sudo systemctl stop ceph-f65a9458-519f-11ed-8438-001a4aab830c@mon.a' [7076173] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:22:11 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076173/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076173/ sentry: https://sentry.ceph.com/organizations/ceph/?query=64a748193922423daf3230d63b24699f Command failed on smithi027 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 40c20c92-51a0-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076175] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:11:09 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076175/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076175/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b7056ec8293a4cefb6e5bcdd39e97f37 Command failed on smithi071 with status 5: 'sudo systemctl stop ceph-4f9bbcb8-51a0-11ed-8438-001a4aab830c@mon.smithi071' [7076177] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:14:25 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076177/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076177/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7833ab51e6f3484f89786c1d78815d8d Command failed on smithi018 with status 5: 'sudo systemctl stop ceph- df399692-51a0-11ed-8438-001a4aab830c@mon.a' [7076182] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:07:55 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076182/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076182/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4535587f997e42d7bbb91811363b8d69 Command failed on smithi061 with status 5: 'sudo systemctl stop ceph-3856f77e-51a1-11ed-8438-001a4aab830c@mon.a' [7076186] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:14:03 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076186/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076186/ sentry: https://sentry.ceph.com/organizations/ceph/?query=899e530a58e8467f961b9dfa9dfd8ef9 Command failed on smithi088 with status 5: 'sudo systemctl stop ceph-3eb75212-51a1-11ed-8438-001a4aab830c@mon.a' [7076188] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:24:25 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076188/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076188/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df52205b8c204a08a35ffdd91f00ca1a Command failed on smithi079 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3e20d0e4-51a1-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076191] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:09:11 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076191/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076191/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4642d6d9275c458083512b6190434473 Command failed on smithi035 with status 5: 'sudo systemctl stop ceph-383c2962-51a1-11ed-8438-001a4aab830c@mon.smithi035' [7076193] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:39 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076193/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076193/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b6fc111704e04e4da275a12a458fb811 Command failed on smithi145 with status 5: 'sudo systemctl stop ceph-697e4712-51a1-11ed-8438-001a4aab830c@mon.a' [7076196] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:09:06 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076196/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076196/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a289ac111c744f9fa0310f126d3b7842 Command failed on smithi137 with status 5: 'sudo systemctl stop ceph-a891bfe2-51a1-11ed-8438-001a4aab830c@mon.smithi137' [7076197] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:14:47 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076197/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076197/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd2e63efdd9f4824a2ffc0dc094ceb77 Command failed on smithi006 with status 5: 'sudo systemctl stop ceph-629a2e10-51a2-11ed-8438-001a4aab830c@mon.a' [7076198] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:06:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076198/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076198/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc57d74abf704ee9b49be3df1a581739 Command failed on smithi157 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' [7076201] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:06:17 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076201/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076201/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9d90151454784f3b8176d73355a4628b Command failed on smithi026 with status 5: 'sudo systemctl stop ceph-644668aa-51a2-11ed-8438-001a4aab830c@mon.a' [7076202] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:08:15 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076202/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076202/ sentry: https://sentry.ceph.com/organizations/ceph/?query=97cb122acf094b239cc9f14880e6c367 Command failed on smithi071 with status 5: 'sudo systemctl stop ceph-b7389696-51a2-11ed-8438-001a4aab830c@mon.smithi071' [7076204] rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} ----------------------------------------------------------------- time: 00:05:55 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076204/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076204/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0c81cd92a371473eb063f27552228885 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a [7076207] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:23:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076207/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076207/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4cbd5843332842748fa638df0f712bc9 Command failed on smithi018 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bb71081e-51a3-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076209] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:11:08 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076209/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076209/ sentry: https://sentry.ceph.com/organizations/ceph/?query=582ad6b603214956a84457ba97bf5122 Command failed on smithi094 with status 5: 'sudo systemctl stop ceph-706ae9d4-51a3-11ed-8438-001a4aab830c@mon.a' [7076210] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:08:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076210/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dfd59076977d4d38bb8a15f85f7291b3 Command failed on smithi057 with status 5: 'sudo systemctl stop ceph-7cb369aa-51a3-11ed-8438-001a4aab830c@mon.smithi057' [7076213] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076213/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076213/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4b0ed13b5b2d4a3ba1db0dc3ba222084 Command failed on smithi062 with status 5: 'sudo systemctl stop ceph-57c1fcb4-51a4-11ed-8438-001a4aab830c@mon.a' [7076217] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} ----------------------------------------------------------------- time: 00:21:02 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076217/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076217/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7f0e358cad1348c7b35df5e6a8cec5b9 Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49212b12-51a4-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076218] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:14:51 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076218/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076218/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd0107a122714a3f85ace786ec48f677 Command failed on smithi155 with status 5: 'sudo systemctl stop ceph-4de9d068-51a4-11ed-8438-001a4aab830c@mon.a' [7076226] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:06:26 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076226/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5857a0d5c12d4152a0aa82f22de15fdd Command failed on smithi032 with status 5: 'sudo systemctl stop ceph- dd3d8026-51a3-11ed-8438-001a4aab830c@mon.smithi032' [7076227] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:08:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076227/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076227/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ab4ef77076a4ebd82b330c911294afe Command failed on smithi093 with status 5: 'sudo systemctl stop ceph-67fc8dd8-51a4-11ed-8438-001a4aab830c@mon.a' [7076230] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:06:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076230/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aac05ecdf42048828b64994da9bc2ba3 Command failed on smithi134 with status 5: 'sudo systemctl stop ceph-354a4d58-51a4-11ed-8438-001a4aab830c@mon.smithi134' [7076233] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:15:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076233/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076233/ sentry: https://sentry.ceph.com/organizations/ceph/?query=52c0b15de94e4cb391e6f4571d256bfd Command failed (workunit test cephadm/test_cephadm.sh) on smithi063 with status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7076237] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:09:46 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076237/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076237/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f9faea27ecab48c7888e9144f019f2f2 Command failed on smithi006 with status 5: 'sudo systemctl stop ceph- fb12f62a-51a4-11ed-8438-001a4aab830c@mon.a' [7076238] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:05:39 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076238/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076238/ sentry: https://sentry.ceph.com/organizations/ceph/?query=facc3311a8e8456c8ea7781545d947b0 Command failed on smithi071 with status 5: 'sudo systemctl stop ceph-1f94e580-51a5-11ed-8438-001a4aab830c@mon.smithi071' [7076239] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:24:49 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076239/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076239/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c4094446d43447d5871e4e24cc777cc4 Command failed on smithi045 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8668308c-51a5-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076244] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:06:41 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076244/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076244/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6eaa4a9ab4ad409580bf643cb21ab037 Command failed on smithi032 with status 5: 'sudo systemctl stop ceph-c784dce6-51a5-11ed-8438-001a4aab830c@mon.a' [7076245] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:24:26 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076245/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076245/ sentry: https://sentry.ceph.com/organizations/ceph/?query=63546678ed8840b199de1739b0c5aa99 Command failed on smithi134 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 307493e0-51a6-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076246] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:10:37 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076246/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc516f1687124bebb78186e0718e8183 Command failed on smithi094 with status 5: 'sudo systemctl stop ceph-4c9c452c-51a6-11ed-8438-001a4aab830c@mon.smithi094' [7076249] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:15:17 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076249/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076249/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc41c3de4c004c4bb8fe9d7c63343620 Command failed on smithi062 with status 5: 'sudo systemctl stop ceph-791ac8fc-51a7-11ed-8438-001a4aab830c@mon.a' [7076250] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:13:04 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076250/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076250/ sentry: https://sentry.ceph.com/organizations/ceph/?query=973ff31204f641ddbe39c598db1e30c6 Command failed on smithi155 with status 5: 'sudo systemctl stop ceph-6c50b910-51a7-11ed-8438-001a4aab830c@mon.a' [7076255] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:49 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076255/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076255/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb5c537eaa7b40f1a2a2cf76f36a9d93 Command failed (workunit test cephadm/test_repos.sh) on smithi110 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7076257] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:09:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076257/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076257/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df62f6fa46a64b95a38aed349726ce28 Command failed on smithi133 with status 5: 'sudo systemctl stop ceph-226a74c6-51a7-11ed-8438-001a4aab830c@mon.a' [7076258] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:06:10 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076258/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076258/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c1fc21970f004d44a778cf4975a34bed Command failed on smithi017 with status 5: 'sudo systemctl stop ceph-54f57f12-51a7-11ed-8438-001a4aab830c@mon.smithi017' [7076259] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:09:31 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076259/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=852ed14934aa422585dc9561f29ba3a5 Command failed on smithi071 with status 5: 'sudo systemctl stop ceph-422be510-51a7-11ed-8438-001a4aab830c@mon.smithi071' [7076261] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:23:57 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076261/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076261/ sentry: https://sentry.ceph.com/organizations/ceph/?query=473672818de14136a98c4cca0b7ffce7 Command failed on smithi081 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8e4fa4c2-51a7-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076268] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} ----------------------------------------------------------------- time: 00:21:16 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076268/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076268/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5dbaaf22d82d4bc29b1ce032f7fd7fa7 Command failed on smithi040 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c985c670-51a7-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)"\'' [7076269] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:14:25 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076269/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6481bfd3de8a4a71a1a89d42efe88579 Command failed on smithi032 with status 5: 'sudo systemctl stop ceph-20ae613c-51a8-11ed-8438-001a4aab830c@mon.a' [7076270] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:07:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076270/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076270/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d4b91aa8bee4ab1ad9ba9f0161592d3 Command failed on smithi033 with status 5: 'sudo systemctl stop ceph- efe7a310-51a7-11ed-8438-001a4aab830c@mon.a' [7076274] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:53 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076274/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076274/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8d51806a625462dac886f8382a3a54d Command failed on smithi094 with status 5: 'sudo systemctl stop ceph-66a9e256-51a8-11ed-8438-001a4aab830c@mon.a' [7076276] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:08:36 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076276/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076276/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c491cb8369f145d3883cc099112aea5d Command failed on smithi027 with status 5: 'sudo systemctl stop ceph-4543425a-51a9-11ed-8438-001a4aab830c@mon.smithi027' [7076278] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:14:11 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076278/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076278/ sentry: https://sentry.ceph.com/organizations/ceph/?query=528d3c8095ca4ba9af1342c528220ddd Command failed on smithi133 with status 5: 'sudo systemctl stop ceph-8fff0efa-51a9-11ed-8438-001a4aab830c@mon.a' [7076282] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:12:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076282/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076282/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb98fa9ff2384f43a1c7737acca51378 Command failed on smithi017 with status 5: 'sudo systemctl stop ceph-c6c25000-51a9-11ed-8438-001a4aab830c@mon.a' [7076284] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:14:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076284/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076284/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c421285ace047148f0af0b5f63c2b13 Command failed on smithi150 with status 5: 'sudo systemctl stop ceph-f210e654-51a9-11ed-8438-001a4aab830c@mon.a' [7076286] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:05:35 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076286/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076286/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5af530578cfd4974b428136deac85079 Command failed on smithi079 with status 5: 'sudo systemctl stop ceph-53844cf6-51a9-11ed-8438-001a4aab830c@mon.smithi079' [7076289] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:24:25 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076289/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076289/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b5b919b33f34e4bb1d584a4bc8617be Command failed on smithi083 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 10822904-51aa-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076292] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:11:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076292/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076292/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b2ff1f0b9e5441faf89f9acf2371167 Command failed on smithi033 with status 5: 'sudo systemctl stop ceph- cfd2f762-51a9-11ed-8438-001a4aab830c@mon.smithi033' [7076294] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:06:37 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076294/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076294/ sentry: https://sentry.ceph.com/organizations/ceph/?query=71f74823cf66422e86575327d9349495 Command failed on smithi043 with status 5: 'sudo systemctl stop ceph-3a17c724-51aa-11ed-8438-001a4aab830c@mon.a' [7076296] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076296/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076296/ sentry: https://sentry.ceph.com/organizations/ceph/?query=03e7f8722a9e4f5dbd0a7490cf74533c Command failed on smithi172 with status 5: 'sudo systemctl stop ceph-b1f2b9a2-51aa-11ed-8438-001a4aab830c@mon.a' [7076299] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:15:11 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076299/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076299/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a9390f5578034e16b5dbf284396509e5 Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-3f1a9aca-51ab-11ed-8438-001a4aab830c@mon.a' [7076301] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:06:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076301/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076301/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0184a5b54ca2406eb31da4c508adb884 Command failed on smithi049 with status 5: 'sudo systemctl stop ceph-61a676f4-51ab-11ed-8438-001a4aab830c@mon.smithi049' [7076305] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:07:46 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076305/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076305/ sentry: https://sentry.ceph.com/organizations/ceph/?query=efad3fa32f7046b3aa35c89e632e802c Command failed on smithi027 with status 5: 'sudo systemctl stop ceph-83f6a184-51ab-11ed-8438-001a4aab830c@mon.a' [7076309] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:15:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076309/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076309/ sentry: https://sentry.ceph.com/organizations/ceph/?query=21203a8cf4cb4be0a470afe12fd91595 Command failed on smithi081 with status 5: 'sudo systemctl stop ceph-469ac80a-51ac-11ed-8438-001a4aab830c@mon.a' [7076312] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:24:57 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076312/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076312/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c2285a2b38574b49a823c89d42492b0d Command failed on smithi145 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3323cbdc-51ac-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076314] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:26:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076314/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076314/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f951aac7d6524a1094099a7b9b6d7dbe Command failed on smithi040 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f8e15e80-51ab-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076322] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:10:51 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076322/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076322/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1d4aeeeb39a4abd8500199f22aea469 Command failed on smithi143 with status 5: 'sudo systemctl stop ceph-63cea84c-51ac-11ed-8438-001a4aab830c@mon.a' [7076323] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:10:36 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076323/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076323/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5441d07d863a4a2f8a144094d0b568a3 Command failed on smithi172 with status 5: 'sudo systemctl stop ceph-9f9e6a9c-51ac-11ed-8438-001a4aab830c@mon.smithi172' [7076325] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:10:16 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076325/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076325/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bcb307228f574f4faa012e39b422713d Command failed on smithi085 with status 5: 'sudo systemctl stop ceph-1dcc24fe-51ad-11ed-8438-001a4aab830c@mon.smithi085' [7076327] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:14:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076327/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076327/ sentry: https://sentry.ceph.com/organizations/ceph/?query=90ada7bc584d4de5b520c1bf4aa4e49f Command failed on smithi049 with status 5: 'sudo systemctl stop ceph- febedf24-51ad-11ed-8438-001a4aab830c@mon.a' [7076331] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} ----------------------------------------------------------------- time: 00:20:28 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076331/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076331/ sentry: https://sentry.ceph.com/organizations/ceph/?query=366e864e94da4225b834901c1a3027fc Command failed on smithi027 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f584b3d4-51ad-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076332] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:07:12 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076332/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076332/ sentry: https://sentry.ceph.com/organizations/ceph/?query=412ad1dbfff1446eaa44d43dac75b295 [Errno 2] Cannot find file on the remote 'ubuntu@smithi154.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [7076333] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:08:20 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076333/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076333/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ed6b113f2ae44e60a969797bbe313fdf Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-0388e216-51ae-11ed-8438-001a4aab830c@mon.a' [7076338] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:08:58 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076338/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076338/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e195fb78a306485bafa660269edd74b8 Command failed on smithi087 with status 5: 'sudo systemctl stop ceph-852621b2-51ae-11ed-8438-001a4aab830c@mon.smithi087' [7076340] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076340/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076340/ sentry: https://sentry.ceph.com/organizations/ceph/?query=743f3b5a4696407e86b83223f743be85 Command failed on smithi130 with status 5: 'sudo systemctl stop ceph-a68845a6-51ae-11ed-8438-001a4aab830c@mon.smithi130' [7076344] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:14:39 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076344/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076344/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b98788410a3d40aa8f9e03028d68d1b5 Command failed (workunit test cephadm/test_cephadm.sh) on smithi107 with status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7076345] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:55 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076345/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076345/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2d349703a6be4e7b8de44f9045fa9ee2 Command failed on smithi138 with status 5: 'sudo systemctl stop ceph- ff4aeb1c-51ae-11ed-8438-001a4aab830c@mon.a' [7076347] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:07:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076347/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076347/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e1fbd0d7ed384797b8c9aa3187963a3b Command failed on smithi035 with status 5: 'sudo systemctl stop ceph-15f613be-51af-11ed-8438-001a4aab830c@mon.a' [7076351] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:23:32 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076351/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076351/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9e2e35020d964ccb89a02b33983543d4 Command failed on smithi133 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9dcc495c-51af-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076355] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:08:24 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076355/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076355/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0e73df12f2f24aee8aa84eef2aa2d534 Command failed on smithi071 with status 5: 'sudo systemctl stop ceph-a7241480-51af-11ed-8438-001a4aab830c@mon.smithi071' [7076358] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076358/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076358/ sentry: https://sentry.ceph.com/organizations/ceph/?query=40c8841957204140a483fe7bee972cce Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-751fa39a-51b0-11ed-8438-001a4aab830c@mon.a' [7076359] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:08:37 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076359/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076359/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99e099bf37284285abcc294bb106af81 Command failed on smithi145 with status 5: 'sudo systemctl stop ceph-b9e9e120-51b0-11ed-8438-001a4aab830c@mon.a' [7076361] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:07:16 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076361/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076361/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d9c4e7dc123d4cfb8cab929aa882cdb0 Command failed (workunit test cephadm/test_repos.sh) on smithi171 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [7076364] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076364/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076364/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d46e953762f147b9915e00c797004d1c Command failed on smithi049 with status 5: 'sudo systemctl stop ceph-b8340f22-51b0-11ed-8438-001a4aab830c@mon.smithi049' [7076365] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:08:26 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076365/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076365/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9745fdc56bfe4162967af393d0c33364 Command failed on smithi040 with status 5: 'sudo systemctl stop ceph-a140375a-51b0-11ed-8438-001a4aab830c@mon.a' [7076367] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:05:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076367/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076367/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72253cd38d0b456a9e2bcc5c1858d2f5 Command failed on smithi130 with status 5: 'sudo systemctl stop ceph-639763c4-51b0-11ed-8438-001a4aab830c@mon.smithi130' [7076369] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:07:13 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076369/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076369/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5ad3a86b1e64d959718399cf87465ae Command failed on smithi035 with status 5: 'sudo systemctl stop ceph- fc6ad8b0-51b0-11ed-8438-001a4aab830c@mon.a' [7076373] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:24:03 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076373/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076373/ sentry: https://sentry.ceph.com/organizations/ceph/?query=197bf03fc2194312ad1fa5182bd32995 Command failed on smithi081 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9adf4efe-51b1-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076374] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} ----------------------------------------------------------------- time: 00:19:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076374/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076374/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4028f770a935403b8bb61a918b402fa2 Command failed on smithi057 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 855e7aa0-51b1-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)"\'' [7076378] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:14:14 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076378/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076378/ sentry: https://sentry.ceph.com/organizations/ceph/?query=89d26e829cb94fd590f6eee842e630ad Command failed on smithi150 with status 5: 'sudo systemctl stop ceph-3cbba02e-51b2-11ed-8438-001a4aab830c@mon.a' [7076381] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:05:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076381/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076381/ sentry: https://sentry.ceph.com/organizations/ceph/?query=647781eda6194df381f68d670ec1dffa Command failed on smithi111 with status 5: 'sudo systemctl stop ceph-50bf3e82-51b2-11ed-8438-001a4aab830c@mon.smithi111' [7076382] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:14 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076382/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076382/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a30249c709c24dfa8701652b84123ccc Command failed on smithi107 with status 5: 'sudo systemctl stop ceph-b338c656-51b1-11ed-8438-001a4aab830c@mon.a' [7076386] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:07:23 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076386/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076386/ sentry: https://sentry.ceph.com/organizations/ceph/?query=62e9b2325c5048aaa7b3331391c0c1a6 Command failed on smithi027 with status 5: 'sudo systemctl stop ceph-7b6bfbca-51b2-11ed-8438-001a4aab830c@mon.a' [7076387] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076387/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076387/ sentry: https://sentry.ceph.com/organizations/ceph/?query=728019ca301546f7bcc521755d0497af Command failed on smithi121 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 683c2caa-51b2-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076388] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:11:04 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076388/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076388/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5baf6353a79b44a1bb7d2af37089190d Command failed on smithi116 with status 5: 'sudo systemctl stop ceph-7d4343d6-51b2-11ed-8438-001a4aab830c@mon.smithi116' [7076393] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:14:33 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076393/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076393/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4933aaae0184d2684675baf763cb931 Command failed on smithi172 with status 5: 'sudo systemctl stop ceph-57414bc8-51b3-11ed-8438-001a4aab830c@mon.a' [7076397] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:14:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076397/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076397/ sentry: https://sentry.ceph.com/organizations/ceph/?query=629985cedcfc4e50b58b24225f95a368 Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-67537a22-51b3-11ed-8438-001a4aab830c@mon.a' [7076400] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:14:38 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076400/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076400/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea2f4e9138e14018b92d77994812f6c0 Command failed on smithi046 with status 5: 'sudo systemctl stop ceph-9df36e0c-51b3-11ed-8438-001a4aab830c@mon.a' [7076401] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:08:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076401/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076401/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c7efe8e5475423f8f7c958a66c4322b Command failed on smithi093 with status 5: 'sudo systemctl stop ceph-4f3d7654-51b3-11ed-8438-001a4aab830c@mon.smithi093' [7076404] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076404/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076404/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f0a1c37094474f37b3c25532834fdc1b Command failed on smithi182 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 03efc6b0-51b4-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076407] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:19 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076407/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076407/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b34a074666a1432bbc9dca1567d311e0 Command failed on smithi087 with status 5: 'sudo systemctl stop ceph- eb2baa86-51b3-11ed-8438-001a4aab830c@mon.a' [7076408] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:08:41 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076408/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076408/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9f51f0475f894fd7a6465667194d4bce Command failed on smithi111 with status 5: 'sudo systemctl stop ceph-4ba15b9a-51b4-11ed-8438-001a4aab830c@mon.smithi111' [7076410] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:14:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076410/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076410/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b7734a2d66ca4bba92e3f2e56d022b90 Command failed on smithi017 with status 5: 'sudo systemctl stop ceph-f4c0c1ca-51b4-11ed-8438-001a4aab830c@mon.a' [7076413] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:06:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076413/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076413/ sentry: https://sentry.ceph.com/organizations/ceph/?query=46f80a7308d14fd480228d11cdb63e2c Command failed on smithi103 with status 5: 'sudo systemctl stop ceph-b957a78e-51b4-11ed-8438-001a4aab830c@mon.a' [7076415] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:08:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076415/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076415/ sentry: https://sentry.ceph.com/organizations/ceph/?query=89c47dec89384aa5955e90892d46a98f Command failed on smithi116 with status 5: 'sudo systemctl stop ceph-e13eefbe-51b4-11ed-8438-001a4aab830c@mon.smithi116' [7076418] rados/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} ----------------------------------------------------------------- time: 00:06:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076418/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076418/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e6d39dfe3d3c4df8bea3ab4e11e22b06 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a [7076420] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:23:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076420/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076420/ sentry: https://sentry.ceph.com/organizations/ceph/?query=40ad39da365e403880583074c3adfc23 Command failed on smithi093 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bb0e9e10-51b5-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076422] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:11:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076422/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076422/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bc0d9bee12b2430583103fc9366a1fe6 Command failed on smithi062 with status 5: 'sudo systemctl stop ceph-a76e8bfe-51b5-11ed-8438-001a4aab830c@mon.a' [7076426] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:05:20 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076426/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076426/ sentry: https://sentry.ceph.com/organizations/ceph/?query=150e1934f7b241baa8d571e5be802da7 Command failed on smithi196 with status 5: 'sudo systemctl stop ceph-2811fa3a-51b5-11ed-8438-001a4aab830c@mon.smithi196' [7076431] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:14:34 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076431/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076431/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32cb15451d374bbc815141cfc2d1eabf Command failed on smithi149 with status 5: 'sudo systemctl stop ceph-4d1b94de-51b6-11ed-8438-001a4aab830c@mon.a' [7076434] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} ----------------------------------------------------------------- time: 00:21:16 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076434/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076434/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb6be0f422ea4dc1aef52b33352a5b77 Command failed on smithi018 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dc5e066e-51b5-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)"\'' [7076437] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:13:50 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076437/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076437/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1aaea30b9e3e4487983039bba5b72320 Command failed on smithi026 with status 5: 'sudo systemctl stop ceph-d0a2c6ce-51b6-11ed-8438-001a4aab830c@mon.a' [7076442] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:05:50 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076442/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076442/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba0abcbae2854e4b9d2420fbf5d26a3c Command failed on smithi121 with status 5: 'sudo systemctl stop ceph-3fab44de-51b6-11ed-8438-001a4aab830c@mon.smithi121' [7076444] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:05:46 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076444/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076444/ sentry: https://sentry.ceph.com/organizations/ceph/?query=78cfb1e63bb94413a008ee6e86d2715a Command failed on smithi142 with status 5: 'sudo systemctl stop ceph-4b012a06-51b6-11ed-8438-001a4aab830c@mon.smithi142' [7076445] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:07:02 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076445/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076445/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5e92ce47042748b8814ac486182744f4 Command failed on smithi103 with status 5: 'sudo systemctl stop ceph-b0593498-51b6-11ed-8438-001a4aab830c@mon.a' [7076450] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076450/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076450/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac48ba20a8b54068a6bd4aac536b96fd Command failed (workunit test cephadm/test_cephadm.sh) on smithi167 with status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7076451] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:08:46 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076451/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076451/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4829c4a2931a473abbae7b04280815ac Command failed on smithi137 with status 5: 'sudo systemctl stop ceph-8cf79af2-51b7-11ed-8438-001a4aab830c@mon.a' [7076453] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:05:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076453/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076453/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e4e130a11f8246c58eee0c6210c6aa3c Command failed on smithi102 with status 5: 'sudo systemctl stop ceph-d112b2c6-51b7-11ed-8438-001a4aab830c@mon.smithi102' [7076454] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:24:17 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076454/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076454/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a3b956638a73455b824fd4bb06957d6e Command failed on smithi164 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fbfc0136-51b7-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076456] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:06:46 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076456/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076456/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2949f44efa664e67a4e14d22e7be5a2d Command failed on smithi083 with status 5: 'sudo systemctl stop ceph- ef4b81dc-51b7-11ed-8438-001a4aab830c@mon.a' [7076460] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:25:08 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076460/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076460/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c61188ff8e774e15a7e2fe6e14b0cb79 Command failed on smithi057 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 49ff7a3e-51b8-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [7076463] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:11:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076463/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076463/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8b83177d8ba6457c816854813d93d133 Command failed on smithi121 with status 5: 'sudo systemctl stop ceph-4b71c78c-51b8-11ed-8438-001a4aab830c@mon.smithi121' [7076465] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:13:56 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076465/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076465/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cb1377ee99ee4440a286e5feb38c0976 Command failed on smithi047 with status 5: 'sudo systemctl stop ceph- fb9c5410-51b8-11ed-8438-001a4aab830c@mon.a' [7076466] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:07:33 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076466/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076466/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91d77428bd7845c982e8acc2e4ac9bf4 Command failed on smithi035 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml' [7076467] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:11:59 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076467/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076467/ sentry: https://sentry.ceph.com/organizations/ceph/?query=edb939fe865448f1938554444fb2325f Command failed on smithi103 with status 5: 'sudo systemctl stop ceph-296d6762-51b9-11ed-8438-001a4aab830c@mon.a' Pass ================================================================= [7076038] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:20:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076038/ [7076040] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 04:43:13 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076040/ [7076042] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:17:03 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076042/ [7076043] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:47 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076043/ [7076044] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:20:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076044/ [7076047] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench} time: 01:27:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076047/ [7076049] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:09 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076049/ [7076051] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/rados_api_tests} time: 00:28:42 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076051/ [7076052] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:16:23 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076052/ [7076053] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind} time: 00:34:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076053/ [7076054] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:44 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076054/ [7076056] rados/singleton/{all/peer mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:13:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076056/ [7076058] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:32 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076058/ [7076060] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:34 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076060/ [7076061] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:19:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076061/ [7076065] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:31:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076065/ [7076067] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:17:28 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076067/ [7076069] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:38:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076069/ [7076071] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:16:54 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076071/ [7076073] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:09:56 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076073/ [7076075] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:12:15 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076075/ [7076076] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:17:22 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076076/ [7076077] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076077/ [7076079] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:31:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076079/ [7076082] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:14:35 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076082/ [7076083] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_cls_all} time: 00:17:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076083/ [7076085] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:27:19 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076085/ [7076086] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:10:37 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076086/ [7076089] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:12:41 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076089/ [7076090] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076090/ [7076091] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:19:37 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076091/ [7076092] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:14:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076092/ [7076093] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 03:11:16 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076093/ [7076094] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:24:15 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076094/ [7076097] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:26:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076097/ [7076098] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/workunits} time: 00:12:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076098/ [7076099] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep} time: 00:24:58 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076099/ [7076101] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:15:37 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076101/ [7076102] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:38 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076102/ [7076103] rados/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr orchestrator_cli} time: 00:17:13 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076103/ [7076104] rados/singleton/{all/radostool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:24:14 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076104/ [7076105] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} time: 00:30:20 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076105/ [7076106] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076106/ [7076107] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:58 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076107/ [7076108] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:08:23 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076108/ [7076111] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:22:52 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076111/ [7076113] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:30:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076113/ [7076115] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:19 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076115/ [7076116] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:27:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076116/ [7076118] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:55 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076118/ [7076120] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:14:51 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076120/ [7076121] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:11:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076121/ [7076122] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:05 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076122/ [7076123] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:27:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076123/ [7076124] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:18:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076124/ [7076128] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076128/ [7076130] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:07:54 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076130/ [7076132] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:48:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076132/ [7076133] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:23:42 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076133/ [7076134] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:08:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076134/ [7076137] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:12:22 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076137/ [7076138] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits} time: 00:31:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076138/ [7076139] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:13:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076139/ [7076140] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind} time: 01:00:21 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076140/ [7076142] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076142/ [7076143] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:55 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076143/ [7076145] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:04 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076145/ [7076147] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:30:03 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076147/ [7076148] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:56 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076148/ [7076151] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:18:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076151/ [7076152] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:43:34 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076152/ [7076154] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076154/ [7076155] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:14:02 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076155/ [7076157] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:33:41 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076157/ [7076159] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:28:25 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076159/ [7076162] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:08:58 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076162/ [7076163] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:05 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076163/ [7076165] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:02 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076165/ [7076166] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076166/ [7076168] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:29:15 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076168/ [7076171] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews} time: 00:10:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076171/ [7076172] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:28:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076172/ [7076174] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:20:54 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076174/ [7076176] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:06 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076176/ [7076178] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep} time: 00:18:46 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076178/ [7076179] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/failover} time: 00:18:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076179/ [7076180] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/one workloads/snaps-few-objects} time: 00:42:31 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076180/ [7076181] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:17:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076181/ [7076183] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:16:18 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076183/ [7076184] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper} time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076184/ [7076185] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:34:58 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076185/ [7076187] rados/objectstore/{backends/filejournal supported-random-distro$/{centos_8}} time: 00:11:17 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076187/ [7076189] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:26:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076189/ [7076190] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:11:58 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076190/ [7076192] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:05 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076192/ [7076194] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:33:47 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076194/ [7076195] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:08:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076195/ [7076199] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 00:59:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076199/ [7076200] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:36:26 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076200/ [7076203] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:12:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076203/ [7076205] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 01:17:34 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076205/ [7076206] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:32:31 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076206/ [7076208] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:23:24 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076208/ [7076211] rados/standalone/{supported-random-distro$/{centos_8} workloads/mgr} time: 00:14:09 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076211/ [7076212] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:17:32 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076212/ [7076214] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:16:23 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076214/ [7076215] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:31:51 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076215/ [7076216] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:17:08 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076216/ [7076219] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:30:39 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076219/ [7076220] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:12:32 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076220/ [7076221] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 01:08:08 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076221/ [7076222] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:09:56 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076222/ [7076223] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/insights} time: 00:19:22 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076223/ [7076224] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/pool-create-delete} time: 00:20:43 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076224/ [7076225] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:21 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076225/ [7076228] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:18:17 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076228/ [7076229] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:22:39 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076229/ [7076231] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076231/ [7076232] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:33:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076232/ [7076234] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:19:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076234/ [7076235] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 01:02:15 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076235/ [7076236] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:38:54 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076236/ [7076240] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:58 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076240/ [7076241] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:25:34 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076241/ [7076242] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:40:42 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076242/ [7076243] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:09:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076243/ [7076247] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:09 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076247/ [7076248] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/rados_workunit_loadgen_mix} time: 00:23:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076248/ [7076251] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:25:19 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076251/ [7076252] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:38:14 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076252/ [7076253] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:26:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076253/ [7076254] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:19:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076254/ [7076256] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:11:55 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076256/ [7076260] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:39 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076260/ [7076262] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:26:57 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076262/ [7076263] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:25:22 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076263/ [7076264] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:37:13 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076264/ [7076265] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:50 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076265/ [7076266] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_5925} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076266/ [7076267] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:14 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076267/ [7076271] rados/standalone/{supported-random-distro$/{centos_8} workloads/misc} time: 00:33:27 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076271/ [7076272] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:14:14 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076272/ [7076273] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:14:42 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076273/ [7076275] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:12:35 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076275/ [7076277] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:45:25 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076277/ [7076279] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:30:33 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076279/ [7076280] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:34:54 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076280/ [7076281] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/sample_fio} time: 00:11:53 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076281/ [7076283] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read} time: 00:25:06 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076283/ [7076285] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076285/ [7076287] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:35:32 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076287/ [7076288] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:34:15 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076288/ [7076290] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:31:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076290/ [7076291] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:13:24 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076291/ [7076293] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:27:16 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076293/ [7076295] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:10:56 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076295/ [7076298] rados/multimon/{clusters/3 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:12:19 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076298/ [7076300] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/rados_api_tests} time: 00:32:46 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076300/ [7076302] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-comp-snappy} supported-random-distro$/{centos_8} tasks/dashboard} time: 01:18:36 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076302/ [7076303] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:20:20 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076303/ [7076304] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} time: 03:07:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076304/ [7076306] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 01:35:16 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076306/ [7076307] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:46:12 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076307/ [7076308] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:15:50 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076308/ [7076310] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/filestore-xfs supported-random-distro$/{centos_8} tasks/progress} time: 00:20:08 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076310/ [7076311] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_api_tests} time: 00:28:10 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076311/ [7076313] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:10:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076313/ [7076315] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency} time: 00:54:54 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076315/ [7076316] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:15:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076316/ [7076317] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr orchestrator_cli} time: 00:16:57 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076317/ [7076318] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076318/ [7076319] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:11:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076319/ [7076320] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} time: 00:33:17 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076320/ [7076321] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 01:09:04 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076321/ [7076324] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench} time: 01:05:12 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076324/ [7076326] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:33:36 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076326/ [7076328] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:11:35 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076328/ [7076329] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:08:57 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076329/ [7076330] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:14:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076330/ [7076334] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:08 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076334/ [7076335] rados/standalone/{supported-random-distro$/{centos_8} workloads/mon} time: 00:46:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076335/ [7076336] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:11:42 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076336/ [7076337] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect} time: 00:19:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076337/ [7076339] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:59:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076339/ [7076341] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:12:39 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076341/ [7076342] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:12:03 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076342/ [7076343] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:15:28 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076343/ [7076346] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:19:17 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076346/ [7076348] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests} time: 00:19:52 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076348/ [7076349] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:13 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076349/ [7076350] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:14:13 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076350/ [7076352] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/prometheus} time: 00:15:17 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076352/ [7076353] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 01:17:49 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076353/ [7076354] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:57:29 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076354/ [7076356] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites} time: 00:23:54 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076356/ [7076357] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:11:32 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076357/ [7076360] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:56 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076360/ [7076362] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object} time: 00:16:31 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076362/ [7076363] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:12 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076363/ [7076366] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:09:50 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076366/ [7076368] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:24:54 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076368/ [7076370] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:36 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076370/ [7076371] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:12:46 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076371/ [7076372] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/set-chunks-read} time: 00:14:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076372/ [7076375] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}} time: 00:16:31 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076375/ [7076376] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:50:00 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076376/ [7076377] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:25 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076377/ [7076379] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/scrub_test} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076379/ [7076380] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:11:47 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076380/ [7076383] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:13:24 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076383/ [7076384] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced} time: 00:24:10 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076384/ [7076385] rados/multimon/{clusters/9 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_clock_no_skews} time: 00:11:42 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076385/ [7076389] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:26 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076389/ [7076390] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:36:51 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076390/ [7076391] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 01:25:55 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076391/ [7076392] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:06 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076392/ [7076394] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/workunits} time: 00:14:16 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076394/ [7076395] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:34:03 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076395/ [7076396] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:11:28 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076396/ [7076398] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} time: 03:21:01 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076398/ [7076399] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-localized} time: 00:26:36 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076399/ [7076402] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:11:15 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076402/ [7076403] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:39:38 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076403/ [7076405] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:09:28 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076405/ [7076406] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/none msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:10:20 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076406/ [7076409] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects} time: 00:29:20 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076409/ [7076411] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:33:34 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076411/ [7076412] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/libcephsqlite} time: 00:18:20 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076412/ [7076414] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:26:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076414/ [7076416] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:17:41 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076416/ [7076417] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:13:23 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076417/ [7076419] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:37:35 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076419/ [7076421] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:45 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076421/ [7076424] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:28:53 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076424/ [7076429] rados/singleton/{all/mon-config mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:13:25 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076429/ [7076430] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:13:42 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076430/ [7076432] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:23 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076432/ [7076433] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:15:55 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076433/ [7076435] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:37 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076435/ [7076436] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:31:31 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076436/ [7076438] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:19:56 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076438/ [7076439] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/crash} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076439/ [7076440] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:11:48 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076440/ [7076441] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:32:25 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076441/ [7076443] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/none msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:23:24 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076443/ [7076446] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:16:13 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076446/ [7076447] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:28:37 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076447/ [7076448] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:39 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076448/ [7076449] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:27:30 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076449/ [7076452] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:35:47 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076452/ [7076455] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:29:07 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076455/ [7076457] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:24:11 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076457/ [7076458] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:16:40 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076458/ [7076459] rados/standalone/{supported-random-distro$/{centos_8} workloads/scrub} time: 01:41:53 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076459/ [7076461] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:40:47 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076461/ [7076462] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:44 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076462/ [7076464] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:58 info: http://pulpito.ceph.com/yuriw-2022-10-20_14:37:48-rados-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7076464/