2022-10-24T19:38:48.035 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-24T19:38:48.038 INFO:teuthology.results:subset: '111/120000'
2022-10-24T19:38:48.039 INFO:teuthology.results:seed: '1274'
2022-10-24T22:34:51.294 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-24T22:34:51.313 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-10-24T22:59:53.777 INFO:teuthology.results:Tests finished! gathering results...
2022-10-24T23:00:06.272 INFO:scrape:Found 173 jobs
2022-10-24T23:00:26.966 INFO:scrape:Found 6 distinct failure reasons
2022-10-24T23:00:26.968 INFO:scrape:Failure: Command failed on smithi040 with status 5: 'sudo systemctl stop ceph-6903097e-53ec-11ed-8438-001a4aab830c@mon.a'
2022-10-24T23:00:26.968 INFO:scrape:122 jobs
2022-10-24T23:00:26.969 INFO:scrape:suites intersection: []
2022-10-24T23:00:26.970 INFO:scrape:suites union: ['0-nvme-loop', '1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', '1-start', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-services/basic', '2-services/client-keyring', '2-services/iscsi', '2-services/mirror', '2-services/nfs', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs2', '2-services/rgw', '2-services/rgw-ingress', '2-thrash', '3-final}', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'distro/centos_8.stream_container_tools', 'distro/rhel_8.4_container_tools_3.0', 'distro/rhel_8.4_container_tools_rhel8', 'distro/ubuntu_18.04', 'distro/ubuntu_20.04', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/osds/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'orch/cephadm/osds/{0-distro/ubuntu_18.04', 'orch/cephadm/osds/{0-distro/ubuntu_20.04', 'orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'orch/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0}', 'orch/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8}', 'orch/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04}', 'orch/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04}', 'orch/cephadm/smoke/{0-nvme-loop', 'orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'orch/cephadm/with-work/{0-distro/ubuntu_18.04', 'orch/cephadm/with-work/{0-distro/ubuntu_20.04', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados', 'root}', 'start', 'start}', 'task/test_e2e}', 'task/test_nfs}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}']
2022-10-24T23:00:26.971 INFO:scrape:
2022-10-24T23:00:26.971 INFO:scrape:Failure: Command failed on smithi005 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7febc46c-53da-11ed-8438-001a4aab830c -e sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''
2022-10-24T23:00:26.972 INFO:scrape:30 jobs
2022-10-24T23:00:26.972 INFO:scrape:suites intersection: []
2022-10-24T23:00:26.973 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '3-upgrade/simple', '3-upgrade/staggered', '4-final}', '4-verify}', '4-verify}}', '4-wait', '5-upgrade-ls', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon_election/classic}', 'mon_election/connectivity}', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9', 'osd}', 'overrides/{ignorelist_health', 'pg-warn}', 'roles', 'tasks/{0-from/v16.2.4']
2022-10-24T23:00:26.973 INFO:scrape:
2022-10-24T23:00:26.974 INFO:scrape:Failure: Command failed on smithi045 with status 1: 'kubectl create -f rook/cluster/examples/kubernetes/ceph/crds.yaml -f rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml'
2022-10-24T23:00:26.974 INFO:scrape:2 jobs: ['7079831', '7080085']
2022-10-24T23:00:26.975 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '3-final', 'k8s/1.21', 'net/calico', 'orch/rook/smoke/{0-distro/ubuntu_18.04', 'rook/1.6.2}']
2022-10-24T23:00:26.975 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'orch/rook/smoke/{0-distro/ubuntu_18.04', 'rook/1.6.2}']
2022-10-24T23:00:26.976 INFO:scrape:
2022-10-24T23:00:26.977 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi157 with status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'
2022-10-24T23:00:26.977 INFO:scrape:4 jobs: ['7079934', '7080041', '7079817', '7080099']
2022-10-24T23:00:26.978 INFO:scrape:suites intersection: ['orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}']
2022-10-24T23:00:26.978 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}']
2022-10-24T23:00:26.979 INFO:scrape:
2022-10-24T23:00:26.979 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi149.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml'
2022-10-24T23:00:26.980 INFO:scrape:1 jobs: ['7079987']
2022-10-24T23:00:26.980 INFO:scrape:suites: ['0-kubeadm', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'k8s/1.21', 'net/calico', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}']
2022-10-24T23:00:26.981 INFO:scrape:
2022-10-24T23:00:26.981 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a
2022-10-24T23:00:26.982 INFO:scrape:2 jobs: ['7079904', '7080088']
2022-10-24T23:00:26.982 INFO:scrape:suites intersection: ['orch/cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}']
2022-10-24T23:00:26.983 INFO:scrape:suites union: ['orch/cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}']
2022-10-24T23:00:26.983 INFO:scrape:
2022-10-24T23:00:26.989 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/
failed:  161
dead:    0
running: 0
waiting: 0
queued:  0
passed:  12


Fail
=================================================================
[7079773]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli}
-----------------------------------------------------------------
time:   00:09:05
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079773/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079773/
sentry: https://sentry.ceph.com/organizations/ceph/?query=526c5855d4d54b47b2193a7d9c42a855

    Command failed on smithi130 with status 5: 'sudo systemctl stop
    ceph-b62a1358-53d5-11ed-8438-001a4aab830c@mon.a'

[7079775]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final}
-----------------------------------------------------------------
time:   00:04:52
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079775/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079775/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d40f1bad794d45c7a1584fbc47c85997

    Command failed on smithi110 with status 5: 'sudo systemctl stop
    ceph-34406c98-53d5-11ed-8438-001a4aab830c@mon.smithi110'

[7079777]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:45
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079777/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079777/
sentry: https://sentry.ceph.com/organizations/ceph/?query=74a4ec1ab5e042a8876b4bbd75d91f34

    Command failed on smithi062 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    f882aa76-53d5-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079779]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:06:36
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079779/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079779/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b143cf7f89c049779f6bd1c51c7ef705

    Command failed on smithi003 with status 5: 'sudo systemctl stop
    ceph-d3a96d52-53d5-11ed-8438-001a4aab830c@mon.a'

[7079781]  orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:31
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079781/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079781/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b1ffbfef05b54fcda9245a0effeb67c7

    Command failed on smithi063 with status 5: 'sudo systemctl stop
    ceph-3260a1bc-53d6-11ed-8438-001a4aab830c@mon.a'

[7079783]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:10:42
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079783/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079783/
sentry: https://sentry.ceph.com/organizations/ceph/?query=13cd8009a40f4a62b51a38a2624374a3

    Command failed on smithi040 with status 5: 'sudo systemctl stop
    ceph-a66bac3c-53d6-11ed-8438-001a4aab830c@mon.a'

[7079785]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final}
-----------------------------------------------------------------
time:   00:05:35
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079785/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079785/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2d6dd4a9ba3344cbb576ea0dcc41ef70

    Command failed on smithi120 with status 5: 'sudo systemctl stop
    ceph-70e306f0-53d6-11ed-8438-001a4aab830c@mon.smithi120'

[7079787]  orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:07:12
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079787/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079787/
sentry: https://sentry.ceph.com/organizations/ceph/?query=944c7856afd84467a5bd702d8f95cf64

    Command failed on smithi049 with status 5: 'sudo systemctl stop
    ceph-8136c80c-53d6-11ed-8438-001a4aab830c@mon.smithi049'

[7079789]  orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e}
-----------------------------------------------------------------
time:   00:10:06
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079789/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079789/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3ecf9623c0924578a05af923786fcf91

    Command failed on smithi043 with status 5: 'sudo systemctl stop
    ceph-d4992f26-53d6-11ed-8438-001a4aab830c@mon.a'

[7079791]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:22:07
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079791/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079791/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2405cf4ac3ec4df8b73203c0bec65ff4

    Command failed on smithi055 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    f4d6797e-53d6-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079793]  orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:21:29
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079793/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079793/
sentry: https://sentry.ceph.com/organizations/ceph/?query=acea1b63dced42d1b8bf9799581eac18

    Command failed on smithi066 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    aed52420-53d6-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079799]  orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:07:01
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079799/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079799/
sentry: https://sentry.ceph.com/organizations/ceph/?query=61eb9a06621c4f25b0e79419feb4f692

    Command failed on smithi057 with status 5: 'sudo systemctl stop ceph-
    ffcc9a3e-53d6-11ed-8438-001a4aab830c@mon.a'

[7079801]  orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final}
-----------------------------------------------------------------
time:   00:07:03
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079801/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079801/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e64bbfeb196e41b7963cefdec5bcd652

    Command failed on smithi045 with status 5: 'sudo systemctl stop
    ceph-257f8534-53d7-11ed-8438-001a4aab830c@mon.smithi045'

[7079803]  orch/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:07:54
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079803/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079803/
sentry: https://sentry.ceph.com/organizations/ceph/?query=185d72ef99124d209fe4535527876818

    Command failed on smithi159 with status 5: 'sudo systemctl stop
    ceph-66ab4e9e-53d7-11ed-8438-001a4aab830c@mon.smithi159'

[7079805]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:09:54
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079805/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079805/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4553f2931a18484ab0da97b364dde517

    Command failed on smithi036 with status 5: 'sudo systemctl stop
    ceph-d3e55f54-53d7-11ed-8438-001a4aab830c@mon.a'

[7079807]  orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic}
-----------------------------------------------------------------
time:   00:19:41
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079807/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079807/
sentry: https://sentry.ceph.com/organizations/ceph/?query=931d0229b63b4ec2a5cdb31bb5e448a5

    Command failed on smithi106 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    dbcf6c6e-53d7-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph orch daemon
    redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r
    .name)"\''

[7079809]  orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:11:49
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079809/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079809/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3a16775736be432ca4db61650e112781

    Command failed on smithi018 with status 5: 'sudo systemctl stop
    ceph-3fa1d77c-53d8-11ed-8438-001a4aab830c@mon.a'

[7079813]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:06:57
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079813/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079813/
sentry: https://sentry.ceph.com/organizations/ceph/?query=24ebbaaecdde41dabe9468b1f8a537ad

    Command failed on smithi006 with status 5: 'sudo systemctl stop
    ceph-f52bd72e-53d7-11ed-8438-001a4aab830c@mon.a'

[7079815]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
-----------------------------------------------------------------
time:   00:08:27
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079815/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079815/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4a84e4ec0e08461b911eab42be928b55

    Command failed on smithi063 with status 5: 'sudo systemctl stop
    ceph-3e04c1cc-53d8-11ed-8438-001a4aab830c@mon.smithi063'

[7079817]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:10:27
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079817/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079817/
sentry: https://sentry.ceph.com/organizations/ceph/?query=371e09f1e6c5469caf53d17c773d9ff4

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi121 with
    status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7079819]  orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:08:30
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079819/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079819/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2ac256de96aa42e6ab696320293c70a1

    Command failed on smithi120 with status 5: 'sudo systemctl stop
    ceph-8248b1b8-53d8-11ed-8438-001a4aab830c@mon.a'

[7079821]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:07:08
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079821/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079821/
sentry: https://sentry.ceph.com/organizations/ceph/?query=940d070632d14339bb442b726ed1b280

    Command failed on smithi074 with status 5: 'sudo systemctl stop
    ceph-74d00554-53d8-11ed-8438-001a4aab830c@mon.a'

[7079823]  orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:08:36
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079823/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079823/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6a370db8471b4d80af30e328b59d32ea

    Command failed on smithi040 with status 5: 'sudo systemctl stop ceph-
    af89912e-53d8-11ed-8438-001a4aab830c@mon.smithi040'

[7079825]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:22:20
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079825/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079825/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7bd7af40e04341e3a9c51caab2c48e3f

    Command failed on smithi032 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fcf831ae-53d8-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079827]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
-----------------------------------------------------------------
time:   00:07:56
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079827/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079827/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cf55247f7d3d46239363c78c8d2d34f5

    Command failed on smithi079 with status 5: 'sudo systemctl stop
    ceph-c7ff7462-53d8-11ed-8438-001a4aab830c@mon.smithi079'

[7079829]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root}
-----------------------------------------------------------------
time:   00:10:14
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079829/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079829/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1d588de5d6cd457abbaa0e3a46f82572

    Command failed on smithi043 with status 5: 'sudo systemctl stop
    ceph-3ba5bc50-53d9-11ed-8438-001a4aab830c@mon.a'

[7079831]  orch/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2}
-----------------------------------------------------------------
time:   00:07:53
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079831/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079831/
sentry: https://sentry.ceph.com/organizations/ceph/?query=84f7a0ed32104a6288042f68570e2bde

    Command failed on smithi045 with status 1: 'kubectl create -f
    rook/cluster/examples/kubernetes/ceph/crds.yaml -f
    rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml'

[7079833]  orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python}
-----------------------------------------------------------------
time:   00:11:17
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079833/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079833/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1139a1c4fd144b6697402d2d8fd3f0f0

    Command failed on smithi044 with status 5: 'sudo systemctl stop
    ceph-c3c2cdd0-53d9-11ed-8438-001a4aab830c@mon.a'

[7079839]  orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:07:29
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079839/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079839/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b5e4e3aa4fa9417684ea0f10157924b3

    Command failed on smithi110 with status 5: 'sudo systemctl stop
    ceph-8e211132-53d9-11ed-8438-001a4aab830c@mon.a'

[7079842]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
-----------------------------------------------------------------
time:   00:04:48
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079842/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079842/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bb197dd618ac41629224801fa4560596

    Command failed on smithi062 with status 5: 'sudo systemctl stop
    ceph-5c74cbec-53d9-11ed-8438-001a4aab830c@mon.smithi062'

[7079845]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:06:34
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079845/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079845/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7772494e376045bcbaa7e7ee3f7bb88f

    Command failed on smithi006 with status 5: 'sudo systemctl stop
    ceph-c6669bf2-53d9-11ed-8438-001a4aab830c@mon.a'

[7079848]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:30
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079848/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079848/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cf31a12ee39d4c16b05239417645912e

    Command failed on smithi005 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    7febc46c-53da-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079851]  orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity}
-----------------------------------------------------------------
time:   00:16:51
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079851/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079851/
sentry: https://sentry.ceph.com/organizations/ceph/?query=045fb340fd8c49b792d5536f6577aa87

    Command failed on smithi080 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    406923ac-53da-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079854]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs}
-----------------------------------------------------------------
time:   00:09:27
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079854/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079854/
sentry: https://sentry.ceph.com/organizations/ceph/?query=43f9d1af5c3a40a8b9760a7a242440d4

    Command failed on smithi154 with status 5: 'sudo systemctl stop ceph-
    cf4cd4d8-53da-11ed-8438-001a4aab830c@mon.a'

[7079857]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
-----------------------------------------------------------------
time:   00:05:44
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079857/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079857/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3bd1134af4f04823836164dbbdf21832

    Command failed on smithi055 with status 5: 'sudo systemctl stop
    ceph-079453ac-53db-11ed-8438-001a4aab830c@mon.smithi055'

[7079860]  orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait}
-----------------------------------------------------------------
time:   00:08:11
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079860/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079860/
sentry: https://sentry.ceph.com/organizations/ceph/?query=df45af8c77f644029c759319b2d120ea

    Command failed on smithi059 with status 5: 'sudo systemctl stop
    ceph-e935cf1c-53da-11ed-8438-001a4aab830c@mon.smithi059'

[7079863]  orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:29
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079863/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079863/
sentry: https://sentry.ceph.com/organizations/ceph/?query=56db76859a69482a9bef308cd1381d85

    Command failed on smithi027 with status 5: 'sudo systemctl stop
    ceph-d79ed29e-53da-11ed-8438-001a4aab830c@mon.a'

[7079866]  orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:17:12
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079866/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079866/
sentry: https://sentry.ceph.com/organizations/ceph/?query=59bcbd79614144b9b7f03ed3143e54ac

    Command failed on smithi045 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    270cbd46-53db-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079869]  orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final}
-----------------------------------------------------------------
time:   00:07:28
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079869/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079869/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8221aacaf92c448d9f47cee115f1287b

    Command failed on smithi053 with status 5: 'sudo systemctl stop
    ceph-3276e116-53db-11ed-8438-001a4aab830c@mon.smithi053'

[7079872]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:10:25
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079872/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079872/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5a38fe8f5dad47739bed8f292c2f0291

    Command failed on smithi057 with status 5: 'sudo systemctl stop
    ceph-d52432ec-53db-11ed-8438-001a4aab830c@mon.a'

[7079875]  orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:07:37
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079875/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079875/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9e74092b70c34052953ce569618c982a

    Command failed on smithi046 with status 5: 'sudo systemctl stop
    ceph-b23e0b4a-53db-11ed-8438-001a4aab830c@mon.a'

[7079878]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli}
-----------------------------------------------------------------
time:   00:09:36
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079878/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079878/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6dd1aba78ded4595875e409e8669d2cd

    Command failed on smithi153 with status 5: 'sudo systemctl stop
    ceph-20c25670-53dc-11ed-8438-001a4aab830c@mon.a'

[7079881]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:06:20
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079881/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079881/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cb8cb3a4b4c94e0e863236e2b00238d2

    Command failed on smithi040 with status 5: 'sudo systemctl stop
    ceph-1b54b39a-53dc-11ed-8438-001a4aab830c@mon.a'

[7079884]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:20:22
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079884/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079884/
sentry: https://sentry.ceph.com/organizations/ceph/?query=40a69bd3372340f49819247e0012f063

    Command failed on smithi071 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    aa8cb2ce-53dc-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079887]  orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:22
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079887/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079887/
sentry: https://sentry.ceph.com/organizations/ceph/?query=58670d9c9f7947a3b15423ec18d4ce80

    Command failed on smithi047 with status 5: 'sudo systemctl stop ceph-
    bad0f8ca-53dc-11ed-8438-001a4aab830c@mon.a'

[7079890]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final}
-----------------------------------------------------------------
time:   00:08:10
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079890/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079890/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ee76f20d05a0437aa9d63b96ea38c7b0

    Command failed on smithi121 with status 5: 'sudo systemctl stop
    ceph-c66060ae-53dc-11ed-8438-001a4aab830c@mon.smithi121'

[7079893]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:10:47
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079893/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079893/
sentry: https://sentry.ceph.com/organizations/ceph/?query=16d1c868de504b5b8423dd27ff6df49a

    Command failed on smithi055 with status 5: 'sudo systemctl stop
    ceph-a9da4aa2-53dd-11ed-8438-001a4aab830c@mon.a'

[7079896]  orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
-----------------------------------------------------------------
time:   00:05:27
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079896/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079896/
sentry: https://sentry.ceph.com/organizations/ceph/?query=33e266da14a24b4c918630bf8d685b3a

    Command failed on smithi053 with status 5: 'sudo systemctl stop
    ceph-04535dd0-53dd-11ed-8438-001a4aab830c@mon.smithi053'

[7079898]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:06:45
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079898/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079898/
sentry: https://sentry.ceph.com/organizations/ceph/?query=55c87ac3781a4e1d8277c872dd47160b

    Command failed on smithi087 with status 5: 'sudo systemctl stop
    ceph-747747f2-53dd-11ed-8438-001a4aab830c@mon.a'

[7079901]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
-----------------------------------------------------------------
time:   00:07:52
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079901/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079901/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3e01a38c413c4178aa3c058eaf3146b0

    Command failed on smithi003 with status 5: 'sudo systemctl stop
    ceph-a87c6b36-53dd-11ed-8438-001a4aab830c@mon.smithi003'

[7079904]  orch/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e}
-----------------------------------------------------------------
time:   00:05:08
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079904/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079904/
sentry: https://sentry.ceph.com/organizations/ceph/?query=84fb8f42fdb3436ba775b9803ab95658

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1
    =d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a

[7079907]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:07
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079907/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079907/
sentry: https://sentry.ceph.com/organizations/ceph/?query=045aa33e7ab04d519ce211bfc6d261f3

    Command failed on smithi044 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    77bb1f64-53de-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079910]  orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:06:44
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079910/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079910/
sentry: https://sentry.ceph.com/organizations/ceph/?query=24a8bc8872464287a84da0da477e7388

    Command failed on smithi018 with status 5: 'sudo systemctl stop
    ceph-24abe6c8-53de-11ed-8438-001a4aab830c@mon.a'

[7079913]  orch/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:07:09
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079913/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079913/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c78f9a5c60154e47a2238761f056d185

    Command failed on smithi179 with status 5: 'sudo systemctl stop
    ceph-99117302-53de-11ed-8438-001a4aab830c@mon.smithi179'

[7079916]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:09:45
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079916/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079916/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cb856f1176454ac39703a1e41d24b6c3

    Command failed on smithi032 with status 5: 'sudo systemctl stop
    ceph-5b4015c8-53df-11ed-8438-001a4aab830c@mon.a'

[7079919]  orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic}
-----------------------------------------------------------------
time:   00:23:42
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079919/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079919/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0d6fa0da44b4497b9b80ceaa7adf480a

    Command failed on smithi050 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    59f092ec-53df-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\''

[7079922]  orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
-----------------------------------------------------------------
time:   00:08:02
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079922/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079922/
sentry: https://sentry.ceph.com/organizations/ceph/?query=03ffd4752dc547c59164cadf89fe78a8

    Command failed on smithi143 with status 5: 'sudo systemctl stop ceph-
    cfbd5096-53df-11ed-8438-001a4aab830c@mon.a'

[7079928]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:05:44
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079928/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079928/
sentry: https://sentry.ceph.com/organizations/ceph/?query=13c3c571a34a457c81483323fb16dca3

    Command failed on smithi055 with status 5: 'sudo systemctl stop
    ceph-47f04c36-53df-11ed-8438-001a4aab830c@mon.smithi055'

[7079931]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:07:40
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079931/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079931/
sentry: https://sentry.ceph.com/organizations/ceph/?query=31d20067201d4f8fb55d25ce77e2b68f

    Command failed on smithi037 with status 5: 'sudo systemctl stop ceph-
    cb73f3be-53df-11ed-8438-001a4aab830c@mon.a'

[7079934]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm}
-----------------------------------------------------------------
time:   00:10:54
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079934/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079934/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e345c773b5434c80aaddd3d3e0a072e2

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi157 with
    status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7079937]  orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:06:12
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079937/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079937/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0a732caa8b214dceb3777c178a237620

    Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-
    dc00adda-53df-11ed-8438-001a4aab830c@mon.smithi018'

[7079940]  orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:08:49
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079940/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079940/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0821e9e9762f40348e161c207fccbcd9

    Command failed on smithi071 with status 5: 'sudo systemctl stop
    ceph-5087fb18-53e0-11ed-8438-001a4aab830c@mon.a'

[7079943]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:05:08
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079943/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079943/
sentry: https://sentry.ceph.com/organizations/ceph/?query=618d389925f44ed191aaa7d3461978e3

    Command failed on smithi040 with status 5: 'sudo systemctl stop ceph-
    abcf59ee-53e0-11ed-8438-001a4aab830c@mon.smithi040'

[7079946]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:25
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079946/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079946/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2852b3ec7d5b4876911ca46cb8554a5a

    Command failed on smithi053 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    4545dc60-53e1-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079949]  orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:20:29
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079949/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079949/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bc98fa933e7f44438707b710cbd7cf9a

    Command failed on smithi055 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    38a6dd9c-53e1-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079952]  orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final}
-----------------------------------------------------------------
time:   00:06:46
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079952/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079952/
sentry: https://sentry.ceph.com/organizations/ceph/?query=369a795ae7bd4de786ec04967e4b8e66

    Command failed on smithi079 with status 5: 'sudo systemctl stop
    ceph-82f63ad2-53e1-11ed-8438-001a4aab830c@mon.smithi079'

[7079955]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
-----------------------------------------------------------------
time:   00:09:42
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079955/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079955/
sentry: https://sentry.ceph.com/organizations/ceph/?query=670f02937e3f4e0c98f11ccd9e3cfffa

    Command failed on smithi137 with status 5: 'sudo systemctl stop ceph-
    ff4353ae-53e1-11ed-8438-001a4aab830c@mon.a'

[7079958]  orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:09:56
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079958/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079958/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8833c735de3b4177af9d718e1a9d4aee

    Command failed on smithi006 with status 5: 'sudo systemctl stop
    ceph-533243f8-53e2-11ed-8438-001a4aab830c@mon.a'

[7079964]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:06:44
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079964/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079964/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ec582c5828494b8b80c8796de043eedc

    Command failed on smithi099 with status 5: 'sudo systemctl stop
    ceph-26387192-53e2-11ed-8438-001a4aab830c@mon.a'

[7079967]  orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:07:41
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079967/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079967/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aa05fe0b0c134caeb7c7f99d51946571

    Command failed on smithi153 with status 5: 'sudo systemctl stop
    ceph-97fc74b8-53e2-11ed-8438-001a4aab830c@mon.a'

[7079970]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final}
-----------------------------------------------------------------
time:   00:08:04
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079970/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079970/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bfa102b1c9d642ecae9efd0173f566e9

    Command failed on smithi164 with status 5: 'sudo systemctl stop
    ceph-c009d87e-53e2-11ed-8438-001a4aab830c@mon.smithi164'

[7079973]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:10
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079973/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079973/
sentry: https://sentry.ceph.com/organizations/ceph/?query=670b4d8b5f944ea2a1e34abb0092cc38

    Command failed on smithi049 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    a46baf4c-53e3-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079976]  orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity}
-----------------------------------------------------------------
time:   00:19:39
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079976/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079976/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2856a96011284927824e3d8ee4a35a92

    Command failed on smithi027 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    d9465df2-53e3-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7079979]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs}
-----------------------------------------------------------------
time:   00:09:33
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079979/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079979/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c0e0e265a1744e299889f71d97b49373

    Command failed on smithi120 with status 5: 'sudo systemctl stop ceph-
    bd42ac0a-53e3-11ed-8438-001a4aab830c@mon.a'

[7079981]  orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:05:35
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079981/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079981/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8ec4d32d1cb84c558d049e664e75ea71

    Command failed on smithi017 with status 5: 'sudo systemctl stop
    ceph-d0541e5a-53e3-11ed-8438-001a4aab830c@mon.smithi017'

[7079983]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:06:40
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079983/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079983/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4da2b7ca7342491289a0b398daa32996

    Command failed on smithi143 with status 5: 'sudo systemctl stop ceph-
    afa93442-53e3-11ed-8438-001a4aab830c@mon.a'

[7079985]  orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:21
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079985/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079985/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3bbc2516febd4b1593ec147f2e7a6413

    Command failed on smithi121 with status 5: 'sudo systemctl stop ceph-
    acebb7f2-53e3-11ed-8438-001a4aab830c@mon.a'

[7079987]  orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master}
-----------------------------------------------------------------
time:   00:06:48
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079987/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079987/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9a30aa75491b480ebef5f0d2960b4613

    [Errno 2] Cannot find file on the remote
    'ubuntu@smithi149.front.sepia.ceph.com':
    'rook/cluster/examples/kubernetes/ceph/operator.yaml'

[7079989]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final}
-----------------------------------------------------------------
time:   00:07:59
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079989/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079989/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d55a9dfa3d814ff3be926ee95d9e0bab

    Command failed on smithi008 with status 5: 'sudo systemctl stop
    ceph-1712a136-53e4-11ed-8438-001a4aab830c@mon.smithi008'

[7079991]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:10:21
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079991/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079991/
sentry: https://sentry.ceph.com/organizations/ceph/?query=082722b9a7a546d396b6008ad5372e73

    Command failed on smithi071 with status 5: 'sudo systemctl stop
    ceph-83da5d4a-53e4-11ed-8438-001a4aab830c@mon.a'

[7079993]  orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
-----------------------------------------------------------------
time:   00:12:00
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079993/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079993/
sentry: https://sentry.ceph.com/organizations/ceph/?query=73d25f2abb414febb0eb16c32d4a1a33

    Command failed on smithi012 with status 5: 'sudo systemctl stop
    ceph-2371d8c4-53e5-11ed-8438-001a4aab830c@mon.a'

[7079995]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli}
-----------------------------------------------------------------
time:   00:09:32
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079995/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079995/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3754ffff93fa4819a1c3b0ce84396c60

    Command failed on smithi093 with status 5: 'sudo systemctl stop
    ceph-d365433e-53e4-11ed-8438-001a4aab830c@mon.a'

[7079997]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
-----------------------------------------------------------------
time:   00:05:04
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079997/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079997/
sentry: https://sentry.ceph.com/organizations/ceph/?query=79cebe6190364de0996cc1246654ebf7

    Command failed on smithi003 with status 5: 'sudo systemctl stop
    ceph-61e5dd04-53e4-11ed-8438-001a4aab830c@mon.smithi003'

[7079999]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:20:36
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079999/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079999/
sentry: https://sentry.ceph.com/organizations/ceph/?query=04c75e4984a14cfe96501d74f2340468

    Command failed on smithi164 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    1ef58160-53e5-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080001]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:06:21
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080001/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080001/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f6675223bf045808999ead8c2384ab6

    Command failed on smithi055 with status 5: 'sudo systemctl stop
    ceph-f0ba2e40-53e4-11ed-8438-001a4aab830c@mon.a'

[7080003]  orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:04
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080003/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080003/
sentry: https://sentry.ceph.com/organizations/ceph/?query=36fffbf9702a474b9e2e241df2894645

    Command failed on smithi053 with status 5: 'sudo systemctl stop
    ceph-4c194fc8-53e5-11ed-8438-001a4aab830c@mon.a'

[7080005]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:10:30
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080005/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080005/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3c5d3eebe13b44708d8b95f5398cbd4a

    Command failed on smithi005 with status 5: 'sudo systemctl stop
    ceph-0ffdfba0-53e6-11ed-8438-001a4aab830c@mon.a'

[7080007]  orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:06:56
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080007/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080007/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b04d08c548424f5784f2f7cb4aae7576

    Command failed on smithi130 with status 5: 'sudo systemctl stop
    ceph-936ff8f4-53e5-11ed-8438-001a4aab830c@mon.smithi130'

[7080009]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
-----------------------------------------------------------------
time:   00:05:28
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080009/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080009/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1971b67efccc4bdabb146d529faa4098

    Command failed on smithi018 with status 5: 'sudo systemctl stop ceph-
    fe6e9a70-53e5-11ed-8438-001a4aab830c@mon.smithi018'

[7080011]  orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e}
-----------------------------------------------------------------
time:   00:09:58
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080011/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080011/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1bb6fd86de56495ebc5036a8e93ba989

    Command failed on smithi171 with status 5: 'sudo systemctl stop
    ceph-4ecff7b6-53e6-11ed-8438-001a4aab830c@mon.a'

[7080013]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:59
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080013/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080013/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5797b675b0344d8e98e2e4dc32dc3874

    Command failed on smithi036 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    4db02d60-53e6-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080015]  orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:21:11
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080015/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080015/
sentry: https://sentry.ceph.com/organizations/ceph/?query=962ec9b3822e457ebd080d7cb76d535d

    Command failed on smithi159 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    0daed392-53e6-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080021]  orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:06:49
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080021/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080021/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4caed4baf8e54b72ac93496ddb993edd

    Command failed on smithi071 with status 5: 'sudo systemctl stop
    ceph-66c1e3a2-53e6-11ed-8438-001a4aab830c@mon.a'

[7080023]  orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
-----------------------------------------------------------------
time:   00:06:47
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080023/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080023/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c06b3b36c24248c3a3a77378040b5078

    Command failed on smithi032 with status 5: 'sudo systemctl stop
    ceph-a26fc630-53e6-11ed-8438-001a4aab830c@mon.smithi032'

[7080025]  orch/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:04:46
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080025/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080025/
sentry: https://sentry.ceph.com/organizations/ceph/?query=434c67c16a63481dbb804aed118614c9

    Command failed on smithi138 with status 5: 'sudo systemctl stop
    ceph-0dd77bde-53e7-11ed-8438-001a4aab830c@mon.smithi138'

[7080027]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:09:36
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080027/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080027/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9c2b302710594957afefe29f87133413

    Command failed on smithi049 with status 5: 'sudo systemctl stop
    ceph-92e6f0ca-53e7-11ed-8438-001a4aab830c@mon.a'

[7080029]  orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic}
-----------------------------------------------------------------
time:   00:16:40
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080029/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080029/
sentry: https://sentry.ceph.com/organizations/ceph/?query=995e27d261a4496d90743dbc320e20cb

    Command failed on smithi133 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    1c0905ce-53e7-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080031]  orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:10:47
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080031/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080031/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7e0ccf378e1541c78e00e09016c51d5c

    Command failed on smithi130 with status 5: 'sudo systemctl stop ceph-
    dc6c1e8c-53e7-11ed-8438-001a4aab830c@mon.a'

[7080035]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:06:48
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080035/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080035/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a72bba3760e346498595e6f30a53dd70

    Command failed on smithi018 with status 5: 'sudo systemctl stop
    ceph-f638269e-53e7-11ed-8438-001a4aab830c@mon.a'

[7080037]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
-----------------------------------------------------------------
time:   00:08:06
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080037/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080037/
sentry: https://sentry.ceph.com/organizations/ceph/?query=df94540537a44e36a3c27e66e60288d0

    Command failed on smithi087 with status 5: 'sudo systemctl stop
    ceph-0b4dc5d4-53e8-11ed-8438-001a4aab830c@mon.smithi087'

[7080039]  orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait}
-----------------------------------------------------------------
time:   00:08:14
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080039/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080039/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e3f105ce538d41a2ba9ffe54dc36c1a1

    Command failed on smithi005 with status 5: 'sudo systemctl stop
    ceph-06cf5c7a-53e8-11ed-8438-001a4aab830c@mon.smithi005'

[7080041]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm}
-----------------------------------------------------------------
time:   00:10:21
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080041/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080041/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3696522da3d145efa1049dd0e4a3b9f0

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi154 with
    status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7080043]  orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:08:14
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080043/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080043/
sentry: https://sentry.ceph.com/organizations/ceph/?query=51adff1c48d24de094a866606b2dcb9f

    Command failed on smithi171 with status 5: 'sudo systemctl stop
    ceph-64528a48-53e8-11ed-8438-001a4aab830c@mon.a'

[7080045]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:07:00
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080045/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080045/
sentry: https://sentry.ceph.com/organizations/ceph/?query=41359b53f2c0414e80e7788df723effb

    Command failed on smithi099 with status 5: 'sudo systemctl stop
    ceph-6c8be380-53e8-11ed-8438-001a4aab830c@mon.a'

[7080047]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:45
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080047/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080047/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c6bbf9e8c9b54325a29ff1230046eb5d

    Command failed on smithi040 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    d07a84c8-53e8-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080049]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final}
-----------------------------------------------------------------
time:   00:07:33
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080049/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080049/
sentry: https://sentry.ceph.com/organizations/ceph/?query=21f913925e8e4bf8a651b65108684d29

    Command failed on smithi164 with status 5: 'sudo systemctl stop
    ceph-9e1f70f6-53e8-11ed-8438-001a4aab830c@mon.smithi164'

[7080051]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
-----------------------------------------------------------------
time:   00:09:32
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080051/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080051/
sentry: https://sentry.ceph.com/organizations/ceph/?query=accdc0228a0345c7a64cbd8f3c31eb5f

    Command failed on smithi153 with status 5: 'sudo systemctl stop
    ceph-20bd2c56-53e9-11ed-8438-001a4aab830c@mon.a'

[7080053]  orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python}
-----------------------------------------------------------------
time:   00:06:58
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080053/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080053/
sentry: https://sentry.ceph.com/organizations/ceph/?query=67e30bce50ca4171806c98dcfadaf39f

    Command failed on smithi052 with status 5: 'sudo systemctl stop
    ceph-4a7fffb4-53e9-11ed-8438-001a4aab830c@mon.a'

[7080057]  orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:07:44
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080057/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080057/
sentry: https://sentry.ceph.com/organizations/ceph/?query=04e98003d077400bbed8753410d9e0f8

    Command failed on smithi061 with status 5: 'sudo systemctl stop
    ceph-a6f781ea-53e9-11ed-8438-001a4aab830c@mon.a'

[7080059]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final}
-----------------------------------------------------------------
time:   00:05:12
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080059/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080059/
sentry: https://sentry.ceph.com/organizations/ceph/?query=56da39da7c204c2eaf2ba5c444920ca0

    Command failed on smithi130 with status 5: 'sudo systemctl stop
    ceph-8139dcc8-53e9-11ed-8438-001a4aab830c@mon.smithi130'

[7080061]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:06:29
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080061/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080061/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3b1b6cfa5ffd4cb9bd7286e4914061a9

    Command failed on smithi159 with status 5: 'sudo systemctl stop
    ceph-c73891ce-53e9-11ed-8438-001a4aab830c@mon.a'

[7080063]  orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
-----------------------------------------------------------------
time:   00:08:00
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080063/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080063/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ea990ee696f0489da903659f9f9acbfd

    Command failed on smithi017 with status 5: 'sudo systemctl stop
    ceph-e35d89e0-53e9-11ed-8438-001a4aab830c@mon.smithi017'

[7080065]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:22:13
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080065/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080065/
sentry: https://sentry.ceph.com/organizations/ceph/?query=08acdfce0a2c48f1836cae1a19f3f65b

    Command failed on smithi005 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    60b8cbfc-53ea-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080067]  orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity}
-----------------------------------------------------------------
time:   00:23:16
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080067/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080067/
sentry: https://sentry.ceph.com/organizations/ceph/?query=109da23eb5ff4158a80c5e23b1bf58e5

    Command failed on smithi079 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    7d7cb96a-53ea-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.mgr | length == 2\'"\'"\'\''

[7080069]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs}
-----------------------------------------------------------------
time:   00:09:46
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080069/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080069/
sentry: https://sentry.ceph.com/organizations/ceph/?query=63b577fc96d74a44af177ad479ad9963

    Command failed on smithi037 with status 5: 'sudo systemctl stop
    ceph-98d7a58a-53ea-11ed-8438-001a4aab830c@mon.a'

[7080071]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
-----------------------------------------------------------------
time:   00:05:28
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080071/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080071/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bbb4248276894f56b18844013c2b1929

    Command failed on smithi171 with status 5: 'sudo systemctl stop
    ceph-a09f3274-53ea-11ed-8438-001a4aab830c@mon.smithi171'

[7080073]  orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:05:25
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080073/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080073/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4270deb728d047198044d2f8165080bd

    Command failed on smithi164 with status 5: 'sudo systemctl stop
    ceph-31506d48-53ea-11ed-8438-001a4aab830c@mon.a'

[7080074]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:06:52
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080074/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080074/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7715c3834a724438963efb6d9a03cfd1

    Command failed on smithi033 with status 5: 'sudo systemctl stop
    ceph-7da1e118-53ea-11ed-8438-001a4aab830c@mon.a'

[7080075]  orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:17:22
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080075/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080075/
sentry: https://sentry.ceph.com/organizations/ceph/?query=973ec26f489441a199b70381b756d7ff

    Command failed on smithi133 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    7f61e70a-53ea-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080076]  orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:07:22
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080076/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080076/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a19a6b5448f74e97a4f3607772605250

    Command failed on smithi055 with status 5: 'sudo systemctl stop
    ceph-9f2342dc-53ea-11ed-8438-001a4aab830c@mon.smithi055'

[7080077]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:10:05
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080077/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080077/
sentry: https://sentry.ceph.com/organizations/ceph/?query=79dcaac9aae64c26b0886a4817a0b2a3

    Command failed on smithi053 with status 5: 'sudo systemctl stop
    ceph-3a7bff80-53eb-11ed-8438-001a4aab830c@mon.a'

[7080078]  orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:07:00
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080078/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080078/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d73e7bcccdce4534a527a276ae056446

    Command failed on smithi008 with status 5: 'sudo systemctl stop
    ceph-5a2c3c78-53eb-11ed-8438-001a4aab830c@mon.a'

[7080079]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli}
-----------------------------------------------------------------
time:   00:09:56
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080079/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080079/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5567d746f61544ceabc69c5c41c69515

    Command failed on smithi003 with status 5: 'sudo systemctl stop
    ceph-3d8c21aa-53eb-11ed-8438-001a4aab830c@mon.a'

[7080080]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:20:48
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080080/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080080/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d6b5978efabb4c9b887f8373c2e62be3

    Command failed on smithi071 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    4cbe2ff6-53eb-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080081]  orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:07:46
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080081/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080081/
sentry: https://sentry.ceph.com/organizations/ceph/?query=72ae58d9a1dc4749b1cdeae2295aed0a

    Command failed on smithi153 with status 5: 'sudo systemctl stop
    ceph-421bdc4c-53eb-11ed-8438-001a4aab830c@mon.smithi153'

[7080082]  orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:21
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080082/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080082/
sentry: https://sentry.ceph.com/organizations/ceph/?query=53764c52d8574fc48f4b1dc69ac8d043

    Command failed on smithi052 with status 5: 'sudo systemctl stop
    ceph-5f25886a-53eb-11ed-8438-001a4aab830c@mon.a'

[7080083]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:08:12
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080083/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080083/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5aad56145d2b448bb094312201839960

    Command failed on smithi130 with status 5: 'sudo systemctl stop
    ceph-77bd2df6-53eb-11ed-8438-001a4aab830c@mon.smithi130'

[7080084]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:10:31
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080084/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080084/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b290d77f13a04716b53b535951d47271

    Command failed on smithi006 with status 5: 'sudo systemctl stop
    ceph-1018ea7c-53ec-11ed-8438-001a4aab830c@mon.a'

[7080085]  orch/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2}
-----------------------------------------------------------------
time:   00:06:39
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080085/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080085/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5bb93cf688d84b82869a5cefad5674b0

    Command failed on smithi154 with status 1: 'kubectl create -f
    rook/cluster/examples/kubernetes/ceph/crds.yaml -f
    rook/cluster/examples/kubernetes/ceph/common.yaml -f operator.yaml'

[7080086]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:06:26
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080086/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080086/
sentry: https://sentry.ceph.com/organizations/ceph/?query=03168ddb4a6b47c483f0fe542218a138

    Command failed on smithi061 with status 5: 'sudo systemctl stop
    ceph-a011ea08-53eb-11ed-8438-001a4aab830c@mon.a'

[7080087]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final}
-----------------------------------------------------------------
time:   00:07:49
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080087/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080087/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6b6436769cee44d7a8cbfea70460234b

    Command failed on smithi161 with status 5: 'sudo systemctl stop ceph-
    ca23fc96-53eb-11ed-8438-001a4aab830c@mon.smithi161'

[7080088]  orch/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e}
-----------------------------------------------------------------
time:   00:05:31
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080088/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080088/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5a3b8b667daf4cb5913b14dfb1dbaf1a

    Failed to fetch package version from https://shaman.ceph.com/api/search/?st
    atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1
    =d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a

[7080089]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:46
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080089/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080089/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1690c912332a454883d1b7fd1099030e

    Command failed on smithi047 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    57aa92b4-53ec-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080090]  orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:06:58
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080090/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080090/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7963d1cd5e0c4edd9cefa9ed2759c392

    Command failed on smithi116 with status 5: 'sudo systemctl stop
    ceph-f52f9dd2-53eb-11ed-8438-001a4aab830c@mon.a'

[7080091]  orch/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:04:56
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080091/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080091/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d06b7d94b0ca4040bd8b684e8c096a25

    Command failed on smithi080 with status 5: 'sudo systemctl stop
    ceph-8ffb0b68-53eb-11ed-8438-001a4aab830c@mon.smithi080'

[7080092]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:10:02
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080092/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080092/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5f969b0f50ce44a9b5bed7772e97f4cd

    Command failed on smithi017 with status 5: 'sudo systemctl stop
    ceph-412481bc-53ec-11ed-8438-001a4aab830c@mon.a'

[7080093]  orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic}
-----------------------------------------------------------------
time:   00:19:41
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080093/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080093/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c0f462fae8cb42b9ac8ee9a8ba04f7a4

    Command failed on smithi164 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    3dff5b24-53ec-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080094]  orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
-----------------------------------------------------------------
time:   00:09:43
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080094/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080094/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3017d58ec62446829fceb50390dc55b8

    Command failed on smithi175 with status 5: 'sudo systemctl stop
    ceph-b4907ca0-53ec-11ed-8438-001a4aab830c@mon.a'

[7080096]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final}
-----------------------------------------------------------------
time:   00:05:17
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080096/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080096/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f16fc472c5f1405db4c65149762763ee

    Command failed on smithi102 with status 5: 'sudo systemctl stop
    ceph-2dc9fda4-53ec-11ed-8438-001a4aab830c@mon.smithi102'

[7080097]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:06:34
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080097/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080097/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cd4d8440e1de4d7287cbb9eab594c1f1

    Command failed on smithi040 with status 5: 'sudo systemctl stop
    ceph-6903097e-53ec-11ed-8438-001a4aab830c@mon.a'

[7080098]  orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:05:16
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080098/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080098/
sentry: https://sentry.ceph.com/organizations/ceph/?query=625afd2694d144c5844ce3f8cf02ff1c

    Command failed on smithi046 with status 5: 'sudo systemctl stop
    ceph-3bc62eb4-53ec-11ed-8438-001a4aab830c@mon.smithi046'

[7080099]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm}
-----------------------------------------------------------------
time:   00:10:14
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080099/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080099/
sentry: https://sentry.ceph.com/organizations/ceph/?query=de585e6ba87a40a1b22f1dac9d1a9678

    Command failed (workunit test cephadm/test_cephadm.sh) on smithi149 with
    status 125: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh'

[7080100]  orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:08:10
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080100/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080100/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ce0882ef5ccc47b9b29527abb168255c

    Command failed on smithi171 with status 5: 'sudo systemctl stop
    ceph-a5fb1d9e-53ec-11ed-8438-001a4aab830c@mon.a'

[7080101]  orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final}
-----------------------------------------------------------------
time:   00:05:12
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080101/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080101/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9c66ce106db847f28e60cf94d47a9982

    Command failed on smithi033 with status 5: 'sudo systemctl stop
    ceph-b8ed51ce-53ec-11ed-8438-001a4aab830c@mon.smithi033'

[7080102]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:47
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080102/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080102/
sentry: https://sentry.ceph.com/organizations/ceph/?query=718e3246bb1140f38ea07ed42bc94d71

    Command failed on smithi055 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    017ce22e-53ed-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080103]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:06:35
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080103/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080103/
sentry: https://sentry.ceph.com/organizations/ceph/?query=04aeaeebcc0b499dab12bb6c4aadef86

    Command failed on smithi043 with status 5: 'sudo systemctl stop
    ceph-f6e4a4be-53ec-11ed-8438-001a4aab830c@mon.a'

[7080104]  orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:20:46
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080104/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080104/
sentry: https://sentry.ceph.com/organizations/ceph/?query=79d2a71f52694ebbab7094535593f23b

    Command failed on smithi012 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    15663dd0-53ed-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080105]  orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
-----------------------------------------------------------------
time:   00:07:21
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080105/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080105/
sentry: https://sentry.ceph.com/organizations/ceph/?query=70da501671dd4291b6cf21d6a2e1d45c

    Command failed on smithi053 with status 5: 'sudo systemctl stop
    ceph-39896958-53ed-11ed-8438-001a4aab830c@mon.smithi053'

[7080106]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root}
-----------------------------------------------------------------
time:   00:10:03
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080106/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080106/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a88689502c57492ea4fd9b42721e6ef7

    Command failed on smithi003 with status 5: 'sudo systemctl stop
    ceph-a2339762-53ed-11ed-8438-001a4aab830c@mon.a'

[7080107]  orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:12:03
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080107/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080107/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5060b73f2d5040d490e7e1c4d9a5c16d

    Command failed on smithi187 with status 5: 'sudo systemctl stop ceph-
    fa3d0af6-53ed-11ed-8438-001a4aab830c@mon.a'

[7080109]  orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:08:00
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080109/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080109/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1fd815b7d0ec45b4a339c17532fa2fc5

    Command failed on smithi052 with status 5: 'sudo systemctl stop
    ceph-592f01a0-53ed-11ed-8438-001a4aab830c@mon.a'

[7080110]  orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag}
-----------------------------------------------------------------
time:   00:05:55
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080110/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080110/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d0e9810c2e9f4fb3b3570e7d391a30d2

    Command failed on smithi099 with status 5: 'sudo systemctl stop
    ceph-a57f7c74-53ed-11ed-8438-001a4aab830c@mon.smithi099'

[7080111]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
-----------------------------------------------------------------
time:   00:08:33
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080111/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080111/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fa15fe74f2a640e2be4895296ed65dc5

    Command failed on smithi008 with status 5: 'sudo systemctl stop
    ceph-81572b58-53ed-11ed-8438-001a4aab830c@mon.smithi008'

[7080112]  orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:21:13
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080112/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080112/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3bdff22f6ca74d33adfb69b1e31b7d06

    Command failed on smithi080 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    dc02da5c-53ed-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\''

[7080113]  orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity}
-----------------------------------------------------------------
time:   00:16:58
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080113/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080113/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c78aa9409dce4ea69bc4bee93ff88ae0

    Command failed on smithi130 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    7558cc08-53ed-11ed-8438-001a4aab830c -e
    sha1=d88f759b6ee30a8b0d9b03e2bbb29f39d48f9f2a -- bash -c \'ceph orch daemon
    redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r
    .name)"\''

[7080114]  orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs}
-----------------------------------------------------------------
time:   00:09:53
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080114/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080114/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cc50803c89414d46b7764615ecf5776c

    Command failed on smithi153 with status 5: 'sudo systemctl stop
    ceph-e54e5d34-53ed-11ed-8438-001a4aab830c@mon.a'

[7080115]  orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:07:57
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080115/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080115/
sentry: https://sentry.ceph.com/organizations/ceph/?query=94ad853597204aa5b6804b9a28495c33

    Command failed on smithi061 with status 5: 'sudo systemctl stop
    ceph-b6f92c02-53ed-11ed-8438-001a4aab830c@mon.a'

[7080116]  orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:05:43
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080116/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080116/
sentry: https://sentry.ceph.com/organizations/ceph/?query=065ecb44ee0e4bc89fbd94d8fdcb2472

    Command failed on smithi087 with status 5: 'sudo systemctl stop
    ceph-5d89b1be-53ed-11ed-8438-001a4aab830c@mon.a'

[7080117]  orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
-----------------------------------------------------------------
time:   00:08:09
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080117/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080117/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b3aa018ef11f438b8fd7ac6c6648406e

    Command failed on smithi186 with status 5: 'sudo systemctl stop ceph-
    cb694ec4-53ed-11ed-8438-001a4aab830c@mon.smithi186'

[7080118]  orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:10:54
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080118/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080118/
sentry: https://sentry.ceph.com/organizations/ceph/?query=996c5cde706140c98d9bf16b5fb8f71a

    Command failed on smithi045 with status 5: 'sudo systemctl stop
    ceph-307783ee-53ee-11ed-8438-001a4aab830c@mon.a'

[7080119]  orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
-----------------------------------------------------------------
time:   00:11:28
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080119/
log:    http://qa-proxy.ceph.com/teuthology/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080119/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4de50d8b4186445d953a1689a7ef9a9b

    Command failed on smithi116 with status 5: 'sudo systemctl stop
    ceph-7a79bd86-53ee-11ed-8438-001a4aab830c@mon.a'



Pass
=================================================================
[7079795] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr orchestrator_cli}
time:   00:18:59
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079795/

[7079797] orch/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi}
time:   00:27:45
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079797/

[7079811] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption}
time:   00:11:37
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079811/

[7079836] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos}
time:   00:08:14
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079836/

[7079925] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption}
time:   00:11:48
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079925/

[7079961] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos}
time:   00:08:21
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7079961/

[7080017] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli}
time:   00:13:28
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080017/

[7080019] orch/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi}
time:   00:26:54
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080019/

[7080033] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption}
time:   00:11:19
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080033/

[7080055] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos}
time:   00:07:54
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080055/

[7080095] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption}
time:   00:11:25
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080095/

[7080108] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos}
time:   00:08:37
info:   http://pulpito.ceph.com/yuriw-2022-10-24_15:01:47-orch-wip-yuri2-testing-2022-10-19-1252-pacific-distro-default-smithi/7080108/