2022-10-15T07:44:46.750 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-15T07:44:46.752 INFO:teuthology.results:subset: '1/8'
2022-10-15T07:44:46.752 INFO:teuthology.results:seed: '9439'
2022-10-15T08:39:08.125 INFO:root:teuthology version: 1.1.1.dev427+g35ea38a9
2022-10-15T08:39:08.155 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-10-15T09:12:11.010 INFO:teuthology.results:Tests finished! gathering results...
2022-10-15T09:12:17.922 INFO:scrape:Found 97 jobs
2022-10-15T09:12:23.507 INFO:scrape:Found 4 distinct failure reasons
2022-10-15T09:12:23.508 INFO:scrape:Failure: Command failed on smithi006 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bce24d82-4c5f-11ed-8437-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1'
2022-10-15T09:12:23.508 INFO:scrape:32 jobs
2022-10-15T09:12:23.509 INFO:scrape:suites intersection: []
2022-10-15T09:12:23.510 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/basic', '2-services/rgw', '2-thrash', '3-final}', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', 'agent/off', 'agent/on', 'base/install', 'cluster/{fixed-3', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'openstack}', 'orch:cephadm/rbd_iscsi/{0-single-container-host', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools}', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8}', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/smoke/{0-distro/ubuntu_20.04', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/thrash/{0-distro/ubuntu_20.04', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/ubuntu_20.04', 'root}', 'start', 'start}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'task/test_nfs}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'tasks/rotate-keys}', 'test_iscsi_pids_limit}}', 'workloads/cephadm_iscsi}']
2022-10-15T09:12:23.510 INFO:scrape:
2022-10-15T09:12:23.511 INFO:scrape:Failure: Command failed on smithi130 with status 1: 'sudo yum -y install ceph-radosgw'
2022-10-15T09:12:23.511 INFO:scrape:22 jobs: ['7064560', '7064548', '7064592', '7064557', '7064611', '7064619', '7064547', '7064606', '7064638', '7064601', '7064578', '7064613', '7064556', '7064640', '7064575', '7064615', '7064632', '7064572', '7064623', '7064636', '7064597', '7064552']
2022-10-15T09:12:23.512 INFO:scrape:suites intersection: []
2022-10-15T09:12:23.513 INFO:scrape:suites union: ['1-start', '2-node-mgr', '2-thrash', '3-tasks/rados_api_tests', '3-tasks/radosbench', 'agent/off', 'agent/on', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8}', 'orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'orchestrator_cli}', 'root}', 'start', 'task/test_adoption}', 'task/test_cephadm}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'task/test_nfs}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'tasks/rotate-keys}', 'test_iscsi_pids_limit}}']
2022-10-15T09:12:23.513 INFO:scrape:
2022-10-15T09:12:23.513 INFO:scrape:Failure: Command failed on smithi033 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fc097940-4c64-11ed-8437-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\''
2022-10-15T09:12:23.514 INFO:scrape:3 jobs: ['7064627', '7064546', '7064579']
2022-10-15T09:12:23.514 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start']
2022-10-15T09:12:23.515 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', '2-ops/rm-zap-wait}', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/osds/{0-distro/ubuntu_20.04']
2022-10-15T09:12:23.515 INFO:scrape:
2022-10-15T09:12:23.516 INFO:scrape:Failure: {'smithi047.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts': 24, 'changed': False, 'invocation': {'module_args': {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False, 'cache_valid_time': 0, 'deb': None, 'default_release': None, 'dpkg_options': 'force-confdef,force-confold', 'force': False, 'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False, 'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present', 'update_cache': True, 'update_cache_retries': 5, 'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': 'Failed to update apt cache: unknown reason'}}
2022-10-15T09:12:23.516 INFO:scrape:1 jobs: ['7064635']
2022-10-15T09:12:23.517 INFO:scrape:suites: ['1-start', '2-thrash', '3-tasks/small-objects', 'fixed-2', 'msgr/async', 'orch:cephadm/thrash/{0-distro/ubuntu_20.04', 'root}']
2022-10-15T09:12:23.517 INFO:scrape:
2022-10-15T09:12:23.521 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/
failed:  57
dead:    1
running: 0
waiting: 0
queued:  0
passed:  39


Fail
=================================================================
[7064546]  orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:11:30
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064546/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064546/
sentry: https://sentry.ceph.com/organizations/ceph/?query=25754eb235ee431a9468ed3e3a44c895

    Command failed on smithi061 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    9b7575e4-4c5e-11ed-8437-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch
    ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk
    \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk
    \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk
    \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid
    $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do
    sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon
    add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep
    5 ; done\n\''

[7064547]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
-----------------------------------------------------------------
time:   00:03:22
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064547/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064547/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8946aaac7593443ea9f3bc01e805a5a7

    Command failed on smithi046 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7064548]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
-----------------------------------------------------------------
time:   00:08:49
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064548/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064548/
sentry: https://sentry.ceph.com/organizations/ceph/?query=e34ea943d58d4482bb47b42f5a62d798

    Command failed on smithi087 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064552]  orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli}
-----------------------------------------------------------------
time:   00:09:11
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064552/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064552/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5bb05cc0f3ed4da69ba930a9a9fac613

    Command failed on smithi063 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064553]  orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi}
-----------------------------------------------------------------
time:   00:07:01
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064553/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064553/
sentry: https://sentry.ceph.com/organizations/ceph/?query=61aee77c647a4517a861992103de8801

    Command failed on smithi005 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fb96f6be-4c5e-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064554]  orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final}
-----------------------------------------------------------------
time:   00:06:25
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064554/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064554/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5491a0cd01c3479592c9acb86a8c3b81

    Command failed on smithi125 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    d3e27f94-4c5e-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064556]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
-----------------------------------------------------------------
time:   00:09:15
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064556/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064556/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c87835a0bf6b4def9b188322132fb37a

    Command failed on smithi066 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064557]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs}
-----------------------------------------------------------------
time:   00:08:50
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064557/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064557/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a889e235489e424395ccb0a5ea2df451

    Command failed on smithi190 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064559]  orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:12:51
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064559/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064559/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4ce0712f153240269e57b6b4267858f1

    Command failed on smithi104 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    ab7d957e-4c5f-11ed-8437-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1'

[7064560]  orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:09:10
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064560/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064560/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c8f562c42bc84f179e2a26664ab8bdd9

    Command failed on smithi130 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064561]  orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:11:16
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064561/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064561/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9134636914a5400caa56e118651a2e51

    Command failed on smithi003 with status 1: 'sudo cephadm --image
    quay.ceph.io/ceph-ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    c638de96-4c5f-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064562]  orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli}
-----------------------------------------------------------------
time:   00:10:50
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064562/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064562/
sentry: https://sentry.ceph.com/organizations/ceph/?query=58ded9360371400087fe8d1b2ff5810a

    Command failed on smithi167 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    b9a3521a-4c5f-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064564]  orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
-----------------------------------------------------------------
time:   00:11:14
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064564/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064564/
sentry: https://sentry.ceph.com/organizations/ceph/?query=27ec57df52bb459c902e6cdb0848b03f

    Command failed on smithi081 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    ab2f9f90-4c5f-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064567]  orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:12:27
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064567/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064567/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8dded26fe6394336aedcefdee8f284a5

    Command failed on smithi085 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    d038b7b8-4c5f-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064568]  orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
-----------------------------------------------------------------
time:   00:11:04
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064568/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064568/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c8a9e5b1b7f54d1385b8a01f51cd41f0

    Command failed on smithi078 with status 1: 'sudo cephadm --image
    quay.ceph.io/ceph-ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    b3bcf73e-4c5f-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064570]  orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:10:08
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064570/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064570/
sentry: https://sentry.ceph.com/organizations/ceph/?query=57786fa710ae4847b77d0a6a20ce1155

    Command failed on smithi006 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    bce24d82-4c5f-11ed-8437-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1'

[7064571]  orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:09:07
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064571/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064571/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8e9661e24133411a8477ac80aeba04b4

    Command failed on smithi134 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fc45cd8c-4c5f-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064572]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:08:47
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064572/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064572/
sentry: https://sentry.ceph.com/organizations/ceph/?query=65642f2204a349d7995cf4030d82dfc9

    Command failed on smithi090 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064575]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
-----------------------------------------------------------------
time:   00:08:52
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064575/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064575/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a6d6d086a0ac4733b1e50d6c13ac15e5

    Command failed on smithi142 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064578]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm}
-----------------------------------------------------------------
time:   00:08:18
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064578/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064578/
sentry: https://sentry.ceph.com/organizations/ceph/?query=147be6749bd54f4bbae50c21877945e9

    Command failed on smithi063 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064579]  orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait}
-----------------------------------------------------------------
time:   00:16:30
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064579/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064579/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f0b2868c8f4b4cba94d12411a7201754

    Command failed on smithi026 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    542c17f8-4c61-11ed-8437-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch
    ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk
    \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk
    \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk
    \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid
    $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do
    sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nwhile ! ceph osd
    dump | grep osd.1 | grep up ; do sleep 5 ; done\n\''

[7064580]  orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
-----------------------------------------------------------------
time:   00:09:24
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064580/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064580/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aefa29aabe804b2bb62b37d6c4fe04d6

    Command failed on smithi005 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    97364abe-4c61-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064584]  orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:07:42
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064584/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064584/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d747756a786b4ad7a0923e171d6bdc71

    Command failed on smithi035 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    6121f6da-4c61-11ed-8437-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1'

[7064585]  orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
-----------------------------------------------------------------
time:   00:12:03
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064585/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064585/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0af90ac5b4df42fc8a3016eb8aca5b22

    Command failed on smithi079 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    aff2eb98-4c61-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064586]  orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:11:58
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064586/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064586/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6d8c5827cad84dc4b2d4f3d1d6b83f45

    Command failed on smithi061 with status 1: 'sudo cephadm --image
    quay.ceph.io/ceph-ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    b34fff10-4c61-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064588]  orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
-----------------------------------------------------------------
time:   00:09:56
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064588/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064588/
sentry: https://sentry.ceph.com/organizations/ceph/?query=db6282c3a528403791da5cf69d7a0dc0

    Command failed on smithi090 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    f75ac816-4c61-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064590]  orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
-----------------------------------------------------------------
time:   00:11:21
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064590/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064590/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2d39be8f1cd54aee931d90976a249b9c

    Command failed on smithi093 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fcd37414-4c61-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064592]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys}
-----------------------------------------------------------------
time:   00:08:15
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064592/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064592/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3e03b05d1bf94c09b1bc7580d4436c6e

    Command failed on smithi104 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064593]  orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_nfs}
-----------------------------------------------------------------
time:   00:10:53
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064593/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064593/
sentry: https://sentry.ceph.com/organizations/ceph/?query=6a74e031fe34413ea4099cddd6055752

    Command failed on smithi053 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fcc5b4dc-4c61-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064595]  orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:07:51
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064595/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064595/
sentry: https://sentry.ceph.com/organizations/ceph/?query=43b3962a61c74a669167b4b5060d6661

    Command failed on smithi116 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    e139b1f0-4c61-11ed-8437-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1'

[7064596]  orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:09:05
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064596/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064596/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5c519706b0554b58bd1ba115e7f8704a

    Command failed on smithi085 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    56c09466-4c62-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064597]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:08:30
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064597/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064597/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ca1721209e3431da151e682a22d7360

    Command failed on smithi132 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064599]  orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli}
-----------------------------------------------------------------
time:   00:08:12
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064599/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064599/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1d1380ce8f0e4dc9989ed28490309679

    Command failed on smithi167 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    6c6dadbc-4c62-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064601]  orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli}
-----------------------------------------------------------------
time:   00:08:12
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064601/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064601/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fca09dc0ecd24baf83650f743b548269

    Command failed on smithi112 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064602]  orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final}
-----------------------------------------------------------------
time:   00:10:43
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064602/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064602/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3eabfbd4a9774a838c2c34083b9639ab

    Command failed on smithi055 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    c57b9932-4c62-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064604]  orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
-----------------------------------------------------------------
time:   00:08:42
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064604/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064604/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eae227222f994784a6466cde105c17e0

    Command failed on smithi047 with status 1: 'sudo cephadm --image
    quay.ceph.io/ceph-ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    1f1f6c2a-4c63-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064606]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:08:22
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064606/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064606/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0ec5e8c57a3e492aabf113d947b5f189

    Command failed on smithi188 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064607]  orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys}
-----------------------------------------------------------------
time:   00:09:00
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064607/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064607/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f4925436e8c45bc82f66302cf47f416

    Command failed on smithi157 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    a2d79f56-4c63-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064609]  orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:11:35
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064609/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064609/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dc40615a988143d5b599ea5d1a817b8b

    Command failed on smithi035 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    35feaf4a-4c64-11ed-8437-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1'

[7064611]  orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root}
-----------------------------------------------------------------
time:   00:08:29
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064611/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064611/
sentry: https://sentry.ceph.com/organizations/ceph/?query=27008b731ee84d29ac70a6faad7721ec

    Command failed on smithi106 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064612]  orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:09:25
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064612/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064612/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ecddddf0b0f94f92b962e06de59f529b

    Command failed on smithi104 with status 1: 'sudo cephadm --image
    quay.ceph.io/ceph-ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    383bbdde-4c64-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064613]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_adoption}
-----------------------------------------------------------------
time:   00:08:29
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064613/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064613/
sentry: https://sentry.ceph.com/organizations/ceph/?query=fc13f31c61884bcab7d821fde1fafb00

    Command failed on smithi087 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064615]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
-----------------------------------------------------------------
time:   00:08:26
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064615/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064615/
sentry: https://sentry.ceph.com/organizations/ceph/?query=28b80a3201a8412db33bf66fd101fc6a

    Command failed on smithi079 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064619]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys}
-----------------------------------------------------------------
time:   00:08:41
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064619/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064619/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3f426a9260904e49883e52ea1008de03

    Command failed on smithi145 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064622]  orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:11:14
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064622/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064622/
sentry: https://sentry.ceph.com/organizations/ceph/?query=41cfe4108e6b488893ea177d6d4af353

    Command failed on smithi083 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    c58fd5da-4c64-11ed-8437-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1'

[7064623]  orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
-----------------------------------------------------------------
time:   00:08:35
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064623/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064623/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4f3cb91ef4bf48938a1f684dbf1c2b34

    Command failed on smithi085 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064624]  orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:09:02
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064624/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064624/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b99cfcafd10842b0985cb78bafb5f7ec

    Command failed on smithi093 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    d0ee7bfc-4c64-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064627]  orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
-----------------------------------------------------------------
time:   00:15:00
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064627/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064627/
sentry: https://sentry.ceph.com/organizations/ceph/?query=95839cbde38c49f19a96199707d0824b

    Command failed on smithi033 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fc097940-4c64-11ed-8437-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch
    ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk
    \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk
    \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk
    \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid
    $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do
    sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon
    add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep
    5 ; done\n\''

[7064628]  orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
-----------------------------------------------------------------
time:   00:08:42
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064628/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064628/
sentry: https://sentry.ceph.com/organizations/ceph/?query=dc6e816214df49ffb4965a0e3156caec

    Command failed on smithi055 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fd4b15e8-4c64-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064629]  orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
-----------------------------------------------------------------
time:   00:08:58
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064629/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064629/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8c7b4b487ada417da92b6d097a2081d3

    Command failed on smithi078 with status 1: 'sudo cephadm --image
    quay.ceph.io/ceph-ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    4131bb7c-4c65-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064631]  orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys}
-----------------------------------------------------------------
time:   00:09:00
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064631/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064631/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2b2bb972bc0f4a79bafd1d3eb5a3fc2c

    Command failed on smithi102 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    6dedbd50-4c65-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'

[7064632]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_nfs}
-----------------------------------------------------------------
time:   00:08:15
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064632/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064632/
sentry: https://sentry.ceph.com/organizations/ceph/?query=54752946d8fe41068153be779d027bcf

    Command failed on smithi063 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064634]  orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:06:59
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064634/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064634/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f473f51386a94a0cb1695336b0363f8e

    Command failed on smithi121 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    7ce12d92-4c65-11ed-8437-001a4aab830c -- ceph-volume lvm zap /dev/nvme4n1'

[7064636]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:08:02
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064636/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064636/
sentry: https://sentry.ceph.com/organizations/ceph/?query=63a49097d83d444a85e86208886bb1d5

    Command failed on smithi190 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064638]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli}
-----------------------------------------------------------------
time:   00:08:29
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064638/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064638/
sentry: https://sentry.ceph.com/organizations/ceph/?query=51f6e7947740425db7c70eb50ad1c6fb

    Command failed on smithi032 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064640]  orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
-----------------------------------------------------------------
time:   00:08:22
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064640/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064640/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c7eafa35af594b8c9c4e5788929c309f

    Command failed on smithi106 with status 1: 'sudo yum -y install ceph-
    radosgw'

[7064642]  orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:11:44
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064642/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064642/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a11d058252724b6491a0267148bbffbc

    Command failed on smithi005 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:c365098ecad370669563ee5c63d97f1160ffad4d shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    04c2b5c2-4c67-11ed-8437-001a4aab830c -- ceph-volume lvm zap
    /dev/vg_nvme/lv_4'



Dead
=================================================================
[7064635]  orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
-----------------------------------------------------------------
time:   00:15:29
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064635/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064635/
sentry: https://sentry.ceph.com/organizations/ceph/?query=437df7ab71e6437db5de36abeb14fa78

    {'smithi047.front.sepia.ceph.com': {'_ansible_no_log': False, 'attempts':
    24, 'changed': False, 'invocation': {'module_args':
    {'allow_unauthenticated': False, 'autoclean': False, 'autoremove': False,
    'cache_valid_time': 0, 'deb': None, 'default_release': None,
    'dpkg_options': 'force-confdef,force-confold', 'force': False,
    'force_apt_get': False, 'install_recommends': None, 'only_upgrade': False,
    'package': None, 'policy_rc_d': None, 'purge': False, 'state': 'present',
    'update_cache': True, 'update_cache_retries': 5,
    'update_cache_retry_max_delay': 12, 'upgrade': None}}, 'msg': 'Failed to
    update apt cache: unknown reason'}}



Pass
=================================================================
[7064549] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:13:14
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064549/

[7064550] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:29:40
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064550/

[7064551] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:36:25
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064551/

[7064555] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic}
time:   00:43:30
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064555/

[7064558] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:19:08
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064558/

[7064563] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:19:10
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064563/

[7064565] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:11:23
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064565/

[7064566] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:10
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064566/

[7064569] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:20:31
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064569/

[7064573] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption}
time:   00:09:33
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064573/

[7064574] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:15:59
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064574/

[7064576] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:32
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064576/

[7064577] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity}
time:   00:32:53
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064577/

[7064581] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:15:13
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064581/

[7064582] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:09:28
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064582/

[7064583] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:33:35
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064583/

[7064587] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:18:37
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064587/

[7064589] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:32
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064589/

[7064591] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:15:54
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064591/

[7064594] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:15:47
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064594/

[7064598] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:21:49
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064598/

[7064600] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:28:51
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064600/

[7064603] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic}
time:   00:43:26
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064603/

[7064605] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:13:08
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064605/

[7064608] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:14:52
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064608/

[7064610] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:10:53
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064610/

[7064614] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:31:13
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064614/

[7064616] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm}
time:   00:16:18
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064616/

[7064617] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:16:46
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064617/

[7064618] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:29:46
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064618/

[7064620] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos}
time:   00:04:52
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064620/

[7064621] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:16:21
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064621/

[7064625] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:29:19
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064625/

[7064626] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
time:   00:31:47
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064626/

[7064630] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:17:31
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064630/

[7064633] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:11:50
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064633/

[7064637] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
time:   00:30:50
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064637/

[7064639] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:13:00
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064639/

[7064641] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:11:18
info:   http://pulpito.ceph.com/adking-2022-10-13_00:30:00-orch:cephadm-wip-adk-testing-2022-10-12-1827-distro-default-smithi/7064641/