2022-09-28T05:27:34.939 INFO:root:teuthology version: 1.1.1.dev424+ga773b061
2022-09-28T05:27:34.940 INFO:teuthology.results:subset: '1/8'
2022-09-28T05:27:34.940 INFO:teuthology.results:seed: '5146'
2022-09-28T06:32:13.758 INFO:root:teuthology version: 1.1.1.dev424+ga773b061
2022-09-28T06:32:13.785 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-09-28T07:21:17.250 INFO:teuthology.results:Tests finished! gathering results...
2022-09-28T07:21:24.298 INFO:scrape:Found 99 jobs
2022-09-28T07:21:30.642 INFO:scrape:Found 3 distinct failure reasons
2022-09-28T07:21:30.644 INFO:scrape:Failure: timeout expired in wait_until_healthy
2022-09-28T07:21:30.644 INFO:scrape:9 jobs: ['7046496', '7046526', '7046470', '7046480', '7046448', '7046515', '7046457', '7046522', '7046493']
2022-09-28T07:21:30.645 INFO:scrape:suites intersection: ['agent/on']
2022-09-28T07:21:30.645 INFO:scrape:suites union: ['0-nvme-loop', 'agent/on', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/smoke/{0-distro/ubuntu_20.04', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/workunits/{0-distro/ubuntu_20.04', 'start}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'task/test_nfs}', 'task/test_orch_cli_mon}', 'task/test_orch_cli}', 'test_iscsi_pids_limit}}']
2022-09-28T07:21:30.646 INFO:scrape:
2022-09-28T07:21:30.646 INFO:scrape:Failure: Command failed on smithi063 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 810a640a-3ef1-11ed-8431-001a4aab830c -e sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''
2022-09-28T07:21:30.647 INFO:scrape:17 jobs: ['7046452', '7046472', '7046505', '7046525', '7046501', '7046487', '7046490', '7046469', '7046441', '7046455', '7046463', '7046513', '7046436', '7046520', '7046437', '7046476', '7046506']
2022-09-28T07:21:30.647 INFO:scrape:suites intersection: []
2022-09-28T07:21:30.648 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-inline/no', '3-inline/yes', '3-upgrade-mgr-staggered', '3-upgrade-with-workload', '3-upgrade/simple', '3-upgrade/staggered', '4-config-upgrade/{fail_fs}', '4-final}', '4-verify}', '4-wait', '5-upgrade-ls', '5-upgrade-with-workload', '6-verify}}', 'agent/off', 'agent/on', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'fail_fs/yes', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mon_election/classic}', 'mon_election/connectivity}', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4']
2022-09-28T07:21:30.648 INFO:scrape:
2022-09-28T07:21:30.649 INFO:scrape:Failure: Command failed on smithi111 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s'
2022-09-28T07:21:30.649 INFO:scrape:1 jobs: ['7046433']
2022-09-28T07:21:30.650 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'test_iscsi_pids_limit}}']
2022-09-28T07:21:30.650 INFO:scrape:
2022-09-28T07:21:30.654 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/
failed:  27
dead:    0
running: 0
waiting: 0
queued:  0
passed:  72


Fail
=================================================================
[7046433]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
-----------------------------------------------------------------
time:   00:03:18
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046433/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046433/
sentry: https://sentry.ceph.com/organizations/ceph/?query=37cfbe55259440dc99f90ad01535fd49

    Command failed on smithi111 with status 1: 'TESTDIR=/home/ubuntu/cephtest
    bash -s'

[7046436]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:41:17
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046436/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046436/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ce8225bb5e2b4f368bb8fcb8d9e0146d

    Command failed on smithi078 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    57354e0c-3ef0-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046437]  orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:37:11
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046437/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046437/
sentry: https://sentry.ceph.com/organizations/ceph/?query=787403518b634a2eaf192c5dee8045f3

    Command failed on smithi093 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    2910571a-3ef0-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046441]  orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic}
-----------------------------------------------------------------
time:   00:15:35
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046441/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046441/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4770aa61790f490ea467797e433d7cb4

    Command failed on smithi109 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    30830e7a-3ef0-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046448]  orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli}
-----------------------------------------------------------------
time:   00:18:30
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046448/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046448/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4845f025c2bf43bcbf17453c16263c65

    timeout expired in wait_until_healthy

[7046452]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:28:15
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046452/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046452/
sentry: https://sentry.ceph.com/organizations/ceph/?query=0b8c0a54b4614551ac582e97a8ef199a

    Command failed on smithi063 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific
    shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    810a640a-3ef1-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046455]  orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
-----------------------------------------------------------------
time:   00:49:49
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046455/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046455/
sentry: https://sentry.ceph.com/organizations/ceph/?query=753d3c6a368e4f93a90fc6a341332f76

    Command failed on smithi036 with status 4: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v15.2.9 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    4d8e846c-3ef1-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph orch
    upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date |
    length == 2\'"\'"\'\''

[7046457]  orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:27:43
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046457/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046457/
sentry: https://sentry.ceph.com/organizations/ceph/?query=532bcb8dbd8943d1a801813e73edf222

    timeout expired in wait_until_healthy

[7046463]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:41:39
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046463/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046463/
sentry: https://sentry.ceph.com/organizations/ceph/?query=da01ddee238a4bfcb216982320a0fd2b

    Command failed on smithi046 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    64f9b580-3ef2-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046469]  orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:37:28
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046469/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046469/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c800109f03194f6e98c12556885fe57d

    Command failed on smithi012 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.5 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    6443db20-3ef2-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046470]  orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:18:52
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046470/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046470/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5017de9d97734e2b9098e62ec92df050

    timeout expired in wait_until_healthy

[7046472]  orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic}
-----------------------------------------------------------------
time:   00:18:21
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046472/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046472/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4bf65826bcf2489a9df135a576395275

    Command failed on smithi017 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    9ca01a06-3ef2-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046476]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:27:54
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046476/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046476/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b0f335e1b9634698b07797a705d51315

    Command failed on smithi040 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific
    shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    4d92359c-3ef3-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046480]  orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_nfs}
-----------------------------------------------------------------
time:   00:15:31
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046480/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046480/
sentry: https://sentry.ceph.com/organizations/ceph/?query=48abcaf09f5048f3b16c1776c7ae7c53

    timeout expired in wait_until_healthy

[7046487]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:39:53
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046487/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046487/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a4f13a3a972a487e8b8ed452b1597374

    Command failed on smithi149 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    b90934d2-3ef4-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046490]  orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
-----------------------------------------------------------------
time:   00:47:29
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046490/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046490/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ef8e0c25eb9b47e68ab5b42675e92149

    Command failed on smithi115 with status 4: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    cdaebe66-3ef4-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph orch
    upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date |
    length == 2\'"\'"\'\''

[7046493]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli_mon}
-----------------------------------------------------------------
time:   00:34:00
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046493/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046493/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ab37e56076cc4f47a046153640641ce7

    timeout expired in wait_until_healthy

[7046496]  orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:25:10
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046496/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046496/
sentry: https://sentry.ceph.com/organizations/ceph/?query=c903e51fc5d54c378f3f09ecb3456894

    timeout expired in wait_until_healthy

[7046501]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:28:18
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046501/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046501/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8105bc4255fc4230a28d939e2edb080c

    Command failed on smithi132 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific
    shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    06e0c19c-3ef6-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046505]  orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:57:50
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046505/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046505/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8366caba4bb74cae9969ae867fadaf1b

    Command failed on smithi063 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v15 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    fff4359e-3ef5-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046506]  orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic}
-----------------------------------------------------------------
time:   00:18:05
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046506/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046506/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ea60e41cffb144139824570435b9d41d

    Command failed on smithi074 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v15.2.9 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    ecc9fe68-3ef5-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046513]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:38:59
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046513/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046513/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2ea8934b429f4b0e95c958eceed2d877

    Command failed on smithi027 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    47bee44a-3ef7-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046515]  orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
-----------------------------------------------------------------
time:   00:15:29
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046515/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046515/
sentry: https://sentry.ceph.com/organizations/ceph/?query=08dd1a8e3dfc4e1e9235e00d841a1051

    timeout expired in wait_until_healthy

[7046520]  orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity}
-----------------------------------------------------------------
time:   00:50:48
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046520/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046520/
sentry: https://sentry.ceph.com/organizations/ceph/?query=26af4b07dd6f4174b1e0cff0e90b6fbe

    Command failed on smithi043 with status 4: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v15.2.0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    1aee71f6-3ef7-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph orch
    upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date |
    length == 2\'"\'"\'\''

[7046522]  orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:28:06
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046522/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046522/
sentry: https://sentry.ceph.com/organizations/ceph/?query=9f247d0a739346c3b0e6322fee9ede00

    timeout expired in wait_until_healthy

[7046525]  orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}}
-----------------------------------------------------------------
time:   00:28:58
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046525/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046525/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5d836fae898b4271b66177a5e9458336

    Command failed on smithi121 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific
    shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    411a04e8-3ef8-11ed-8431-001a4aab830c -e
    sha1=289ba8fc20baf2167f553eecef07efe66824b14a -- bash -c \'ceph versions |
    jq -e \'"\'"\'.overall | length == 1\'"\'"\'\''

[7046526]  orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli}
-----------------------------------------------------------------
time:   00:21:05
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046526/
log:    http://qa-proxy.ceph.com/teuthology/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046526/
sentry: https://sentry.ceph.com/organizations/ceph/?query=15d714cddc4e4efba6b098e20fd86b2a

    timeout expired in wait_until_healthy



Pass
=================================================================
[7046432] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:10:48
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046432/

[7046434] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
time:   00:27:33
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046434/

[7046435] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:11:14
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046435/

[7046438] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli}
time:   00:13:07
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046438/

[7046439] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi}
time:   00:26:30
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046439/

[7046440] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/basic 3-final}
time:   00:14:31
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046440/

[7046442] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
time:   00:28:23
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046442/

[7046443] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs}
time:   00:31:07
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046443/

[7046444] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:17:47
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046444/

[7046445] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start}
time:   00:18:20
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046445/

[7046446] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root}
time:   00:40:15
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046446/

[7046447] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:42:03
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046447/

[7046449] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:17:35
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046449/

[7046450] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:21:42
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046450/

[7046451] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:11:23
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046451/

[7046453] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon}
time:   00:23:05
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046453/

[7046454] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys}
time:   00:22:28
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046454/

[7046456] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:18:33
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046456/

[7046458] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
time:   01:00:55
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046458/

[7046459] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests}
time:   00:40:00
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046459/

[7046460] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption}
time:   00:08:12
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046460/

[7046461] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:13:37
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046461/

[7046462] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python}
time:   00:28:08
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046462/

[7046464] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm}
time:   00:19:59
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046464/

[7046465] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:16:21
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046465/

[7046466] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys}
time:   00:35:21
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046466/

[7046467] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
time:   00:13:44
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046467/

[7046468] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm_repos}
time:   00:10:10
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046468/

[7046471] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
time:   00:30:59
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046471/

[7046473] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:33:52
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046473/

[7046474] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:16:39
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046474/

[7046475] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}}
time:   00:12:11
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046475/

[7046477] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:21:26
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046477/

[7046478] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:15:57
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046478/

[7046479] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys}
time:   00:28:35
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046479/

[7046481] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate}
time:   00:16:26
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046481/

[7046482] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:12:18
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046482/

[7046483] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
time:   00:34:09
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046483/

[7046484] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
time:   00:38:39
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046484/

[7046485] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:22:14
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046485/

[7046486] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli}
time:   00:12:32
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046486/

[7046488] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli}
time:   00:12:51
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046488/

[7046489] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final}
time:   00:10:35
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046489/

[7046491] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
time:   00:29:05
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046491/

[7046492] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:12:37
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046492/

[7046494] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys}
time:   00:22:17
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046494/

[7046495] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:15:32
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046495/

[7046497] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:10:15
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046497/

[7046498] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root}
time:   00:39:56
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046498/

[7046499] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:33:28
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046499/

[7046500] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_adoption}
time:   00:14:21
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046500/

[7046502] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:28:22
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046502/

[7046503] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm}
time:   00:15:59
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046503/

[7046504] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:17:59
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046504/

[7046507] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys}
time:   00:27:54
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046507/

[7046508] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos}
time:   00:04:36
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046508/

[7046509] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:16:06
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046509/

[7046510] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start}
time:   00:18:01
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046510/

[7046511] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root}
time:   00:58:05
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046511/

[7046512] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests}
time:   00:41:10
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046512/

[7046514] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:14:11
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046514/

[7046516] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python}
time:   00:22:05
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046516/

[7046517] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final}
time:   00:16:11
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046517/

[7046518] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys}
time:   00:22:24
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046518/

[7046519] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_nfs}
time:   00:30:35
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046519/

[7046521] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:11:29
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046521/

[7046523] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root}
time:   00:42:11
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046523/

[7046524] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:40:31
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046524/

[7046527] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:12:37
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046527/

[7046528] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:26:43
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046528/

[7046529] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:10:38
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046529/

[7046530] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon}
time:   00:34:23
info:   http://pulpito.ceph.com/adking-2022-09-28_01:39:07-orch:cephadm-wip-adk-testing-2022-09-27-1828-distro-default-smithi/7046530/