2022-01-07T12:27:53.882 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-07T12:27:53.884 INFO:teuthology.results:subset: '1/999'
2022-01-07T12:27:53.884 INFO:teuthology.results:seed: '4648'
2022-01-07T13:19:07.536 INFO:root:teuthology version: 1.1.0-95a7d479
2022-01-07T13:19:07.588 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2022-01-08T01:20:03.984 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds
2022-01-08T01:20:13.186 INFO:scrape:Found 93 jobs
2022-01-08T01:20:18.145 INFO:scrape:Found 7 distinct failure reasons
2022-01-08T01:20:18.146 INFO:scrape:Failure: Command failed on smithi026 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f0ec832e-6fb8-11ec-8c32-001a4aab830c -- ceph orch daemon add osd smithi026:vg_nvme/lv_4'
2022-01-08T01:20:18.147 INFO:scrape:10 jobs: ['6600966', '6600946', '6600977', '6600972', '6601030', '6600957', '6601003', '6600962', '6601015', '6600981']
2022-01-08T01:20:18.147 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{ubuntu_18.04}', 'rados', 'thrashosds-health', 'three-plus-one}']
2022-01-08T01:20:18.151 INFO:scrape:suites union: ['1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}']
2022-01-08T01:20:18.151 INFO:scrape:
2022-01-08T01:20:18.152 INFO:scrape:Failure: SSH connection to smithi084 was lost: 'uname -r'
2022-01-08T01:20:18.152 INFO:scrape:9 jobs: ['6601009', '6600992', '6601019', '6600993', '6601025', '6600979', '6601034', '6600988', '6601004']
2022-01-08T01:20:18.153 INFO:scrape:suites intersection: []
2022-01-08T01:20:18.154 INFO:scrape:suites union: ['0-nvme-loop', '1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/octopus', '1-start', '2-ops/repave-all}', 'backoff/normal', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mode/packaged', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr/async-v1only', 'rados', 'rados:cephadm/osds/{0-distro/ubuntu_18.04', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados:cephadm/with-work/{0-distro/ubuntu_18.04', 'start', 'tasks/rados_api_tests}', 'thrashers/careful', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}']
2022-01-08T01:20:18.154 INFO:scrape:
2022-01-08T01:20:18.155 INFO:scrape:Failure: Command failed on smithi064 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f6a7d286-6fb9-11ec-8c32-001a4aab830c -- bash -c \'ceph --format=json mds versions | jq -e ". | add == 4"\''
2022-01-08T01:20:18.155 INFO:scrape:1 jobs: ['6600975']
2022-01-08T01:20:18.156 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}']
2022-01-08T01:20:18.156 INFO:scrape:
2022-01-08T01:20:18.157 INFO:scrape:Failure: Command failed on smithi089 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn'
2022-01-08T01:20:18.157 INFO:scrape:4 jobs: ['6600986', '6601031', '6600985', '6601032']
2022-01-08T01:20:18.158 INFO:scrape:suites intersection: []
2022-01-08T01:20:18.158 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/iscsi', '2-services/nfs-ingress2', '3-final}', 'distro/ubuntu_18.04', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'rados:cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados:cephadm/smoke/{0-nvme-loop', 'start}']
2022-01-08T01:20:18.158 INFO:scrape:
2022-01-08T01:20:18.159 INFO:scrape:Dead: b'2022-01-08T01:20:14.521 INFO:journalctl@ceph.mon.smithi164.smithi164.stdout:Jan 08 01:20:14 smithi164 conmon[59819]: cluster 2022-01-08T01:20:13.081003+0000 mgr.smithi072.mpqmpz (mgr.34104) 23881 : cluster [DBG] pgmap v21068: 129 pgs: 129 active+clean; 199 MiB data, 624 MiB used, 708 GiB / 715 GiB avail; 170 B/s rd, 0 op/s'
2022-01-08T01:20:18.159 INFO:scrape:1 jobs: ['6601029']
2022-01-08T01:20:18.160 INFO:scrape:suites: ['1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools']
2022-01-08T01:20:18.160 INFO:scrape:
2022-01-08T01:20:18.161 INFO:scrape:Dead: b'2022-01-08T01:04:38.143 DEBUG:teuthology.exit:Finished running handlers'
2022-01-08T01:20:18.161 INFO:scrape:3 jobs: ['6600997', '6600983', '6600952']
2022-01-08T01:20:18.162 INFO:scrape:suites intersection: ['1-start', '2-nfs', '3-upgrade-with-workload', '4-final}']
2022-01-08T01:20:18.162 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0', 'rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools']
2022-01-08T01:20:18.163 INFO:scrape:
2022-01-08T01:20:18.163 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi003 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2022-01-08T01:20:18.165 INFO:scrape:1 jobs: ['6600950']
2022-01-08T01:20:18.165 INFO:scrape:suites: ['rados:cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0', 'task/test_e2e}']
2022-01-08T01:20:18.166 INFO:scrape:
2022-01-08T01:20:18.169 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi
=================================================================
info:    http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/
failed:  16
dead:    12
running: 1
waiting: 0
queued:  0
passed:  64


Fail
=================================================================
[6600946]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:02:36
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600946/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600946/
sentry: https://sentry.ceph.com/organizations/ceph/?query=32e7ab6aa5b44b9abb81e593a949c023

[6600950]  rados:cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0 task/test_e2e}
-----------------------------------------------------------------
time:   00:19:37
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600950/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600950/
sentry: https://sentry.ceph.com/organizations/ceph/?query=672297b9cf364eb1a46bf1f97d5d07c4

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi003
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0
    CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[6600957]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:08:51
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600957/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600957/
sentry: https://sentry.ceph.com/organizations/ceph/?query=467f58f097ad44be8dfc99fbdc8c2a13

    Command failed on smithi098 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    43319a94-6fb8-11ec-8c32-001a4aab830c -- ceph orch daemon add osd
    smithi098:vg_nvme/lv_4'

[6600962]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:08:52
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600962/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600962/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f011781d67024d09a2f228597f4cb36d

    Command failed on smithi006 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    c25080b0-6fb8-11ec-8c32-001a4aab830c -- ceph orch daemon add osd
    smithi006:vg_nvme/lv_4'

[6600966]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:09:27
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600966/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600966/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f505656648f64207b0ae097f43e9bd3c

    Command failed on smithi026 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    f0ec832e-6fb8-11ec-8c32-001a4aab830c -- ceph orch daemon add osd
    smithi026:vg_nvme/lv_4'

[6600972]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:09:40
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600972/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600972/
sentry: https://sentry.ceph.com/organizations/ceph/?query=65816da6c5e74ef69b7290088d4a6aa4

    Command failed on smithi016 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    435c8f8c-6fb9-11ec-8c32-001a4aab830c -- ceph orch daemon add osd
    smithi016:vg_nvme/lv_4'

[6600975]  rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}}
-----------------------------------------------------------------
time:   00:13:57
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600975/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600975/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d1ccf77ef8bf418f94efc20eb3600dca

    Command failed on smithi064 with status 1: 'sudo
    /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    f6a7d286-6fb9-11ec-8c32-001a4aab830c -- bash -c \'ceph --format=json mds
    versions | jq -e ". | add == 4"\''

[6600977]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:09:23
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600977/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600977/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b874915384db4144a169fcfae7700dfc

    Command failed on smithi002 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    c01e2274-6fb9-11ec-8c32-001a4aab830c -- ceph orch daemon add osd
    smithi002:vg_nvme/lv_4'

[6600981]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:09:42
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600981/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600981/
sentry: https://sentry.ceph.com/organizations/ceph/?query=42b87246f43944e0a7b1094088c2671a

    Command failed on smithi038 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    2b7ca324-6fba-11ec-8c32-001a4aab830c -- ceph orch daemon add osd
    smithi038:vg_nvme/lv_4'

[6600985]  rados:cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final}
-----------------------------------------------------------------
time:   00:03:20
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600985/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600985/
sentry: https://sentry.ceph.com/organizations/ceph/?query=977753fdc9ae45bcb9e9403b33564749

    Command failed on smithi050 with status 251: 'sudo mkdir -p
    /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee
    /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir
    -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo
    /dev/vg_nvme/lv_1 | sudo tee
    /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1
    | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable &&
    sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1
    /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t
    loop -n lv_1 -q hostnqn'

[6600986]  rados:cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start}
-----------------------------------------------------------------
time:   00:03:22
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600986/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600986/
sentry: https://sentry.ceph.com/organizations/ceph/?query=48cebc5f8fb140d0a7882fd9a411c43e

    Command failed on smithi089 with status 251: 'sudo mkdir -p
    /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee
    /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir
    -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo
    /dev/vg_nvme/lv_1 | sudo tee
    /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1
    | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable &&
    sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1
    /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t
    loop -n lv_1 -q hostnqn'

[6601003]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:09:04
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601003/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601003/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1c9f0ec4faf64f36a6b3dd9711e60cb5

    Command failed on smithi026 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    9c2eac88-6fbb-11ec-8c32-001a4aab830c -- ceph orch daemon add osd
    smithi026:vg_nvme/lv_4'

[6601015]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:09:27
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601015/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601015/
sentry: https://sentry.ceph.com/organizations/ceph/?query=48f4a3228b5b4e768720a2df09b18ff1

    Command failed on smithi002 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    8b1a2c0a-6fbc-11ec-8c32-001a4aab830c -- ceph orch daemon add osd
    smithi002:vg_nvme/lv_4'

[6601030]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:08:58
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601030/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601030/
sentry: https://sentry.ceph.com/organizations/ceph/?query=64ffa9319fe045b5972fd980ed7738da

    Command failed on smithi008 with status 22: 'sudo
    /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-
    ci/ceph:e6d739d3acbd78e5fb4ee5f072efc21d7c0af8c0 shell -c
    /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid
    a33611c2-6fbd-11ec-8c32-001a4aab830c -- ceph orch daemon add osd
    smithi008:vg_nvme/lv_4'

[6601031]  rados:cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final}
-----------------------------------------------------------------
time:   00:03:25
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601031/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601031/
sentry: https://sentry.ceph.com/organizations/ceph/?query=be98d3075bfa4b568dff92590d027ad8

    Command failed on smithi012 with status 251: 'sudo mkdir -p
    /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee
    /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir
    -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo
    /dev/vg_nvme/lv_1 | sudo tee
    /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1
    | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable &&
    sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1
    /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t
    loop -n lv_1 -q hostnqn'

[6601032]  rados:cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start}
-----------------------------------------------------------------
time:   00:03:23
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601032/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601032/
sentry: https://sentry.ceph.com/organizations/ceph/?query=959193811ccb46cda37277cd21e69b81

    Command failed on smithi053 with status 251: 'sudo mkdir -p
    /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee
    /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir
    -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo
    /dev/vg_nvme/lv_1 | sudo tee
    /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1
    | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable &&
    sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1
    /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t
    loop -n lv_1 -q hostnqn'



Dead
=================================================================
[6600952]  rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600952/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600952/

    hit max job timeout

[6600979]  rados:cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600979/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600979/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b1b72c55772845488804b8799622ba5f

    SSH connection to smithi185 was lost: 'uname -r'

[6600983]  rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600983/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600983/

    hit max job timeout

[6600988]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600988/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600988/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b75cfd6b04054f18b2d7d7e2be845056

    SSH connection to smithi150 was lost: 'uname -r'

[6600992]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600992/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600992/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8c64651af798469fbf5fbe0edc9a1e7d

    SSH connection to smithi154 was lost: 'uname -r'

[6600993]  rados:cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600993/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600993/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2a534b4faf1041f38b3676870bbf24a5

    SSH connection to smithi170 was lost: 'uname -r'

[6600997]  rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600997/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600997/

    hit max job timeout

[6601004]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601004/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601004/
sentry: https://sentry.ceph.com/organizations/ceph/?query=f2a603293deb4e8e8e089e2d3ee9f4d9

    SSH connection to smithi198 was lost: 'uname -r'

[6601009]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601009/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601009/
sentry: https://sentry.ceph.com/organizations/ceph/?query=af28388293be466b803fc9c804bfa6f0

    SSH connection to smithi084 was lost: 'uname -r'

[6601019]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601019/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601019/
sentry: https://sentry.ceph.com/organizations/ceph/?query=63a212913f3544a186cf28a7a5c58ea9

    SSH connection to smithi063 was lost: 'uname -r'

[6601025]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601025/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601025/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5ca6515b2ed349e18dd0ddce7b4d3ebb

    SSH connection to smithi150 was lost: 'uname -r'

[6601034]  rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601034/
log:    http://qa-proxy.ceph.com/teuthology/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601034/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a6e252a2a8344e72a865967da415e8d3

    SSH connection to smithi135 was lost: 'uname -r'



Running
=================================================================
[6601029] rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final}
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601029/



Pass
=================================================================
[6600945] rados:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:11:16
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600945/

[6600947] rados:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:35:01
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600947/

[6600948] rados:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final}
time:   00:13:29
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600948/

[6600949] rados:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root}
time:   00:30:47
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600949/

[6600951] rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:00
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600951/

[6600953] rados:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.2_container_tools_3.0} 2-node-mgr orchestrator_cli}
time:   00:15:05
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600953/

[6600954] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start}
time:   00:14:48
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600954/

[6600955] rados:cephadm/smoke-singlehost/{0-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/basic 3-final}
time:   00:12:11
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600955/

[6600956] rados:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic}
time:   00:30:05
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600956/

[6600958] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos}
time:   00:06:18
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600958/

[6600959] rados:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:14:17
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600959/

[6600960] rados:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:17:41
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600960/

[6600961] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start}
time:   00:16:06
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600961/

[6600963] rados:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:21:17
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600963/

[6600964] rados:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final}
time:   00:12:56
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600964/

[6600965] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start}
time:   00:12:24
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600965/

[6600967] rados:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root}
time:   00:37:42
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600967/

[6600968] rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:22:41
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600968/

[6600969] rados:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:17:34
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600969/

[6600970] rados:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs}
time:   00:23:33
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600970/

[6600971] rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final}
time:   00:19:48
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600971/

[6600973] rados:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start}
time:   00:19:20
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600973/

[6600974] rados:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:46:53
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600974/

[6600976] rados:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity}
time:   00:29:42
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600976/

[6600978] rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final}
time:   00:21:03
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600978/

[6600980] rados:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start}
time:   00:19:44
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600980/

[6600982] rados:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root}
time:   00:34:48
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600982/

[6600984] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli}
time:   00:12:01
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600984/

[6600987] rados:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:35:13
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600987/

[6600989] rados:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:13:47
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600989/

[6600990] rados:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final}
time:   00:14:21
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600990/

[6600991] rados:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start}
time:   00:17:42
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600991/

[6600994] rados:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final}
time:   00:13:26
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600994/

[6600995] rados:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root}
time:   00:47:29
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600995/

[6600996] rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:18
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600996/

[6600998] rados:cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:13:17
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600998/

[6600999] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start}
time:   00:15:30
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6600999/

[6601000] rados:cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final}
time:   00:17:54
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601000/

[6601001] rados:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic}
time:   00:23:54
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601001/

[6601002] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption}
time:   00:09:53
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601002/

[6601005] rados:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final}
time:   00:16:49
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601005/

[6601006] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start}
time:   00:15:11
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601006/

[6601007] rados:cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait}
time:   00:13:56
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601007/

[6601008] rados:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python}
time:   00:25:50
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601008/

[6601010] rados:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final}
time:   00:13:14
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601010/

[6601011] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start}
time:   00:12:30
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601011/

[6601012] rados:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm}
time:   00:16:43
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601012/

[6601013] rados:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root}
time:   00:31:28
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601013/

[6601014] rados:cephadm/mgr-nfs-upgrade/{0-distro/centos_8.3_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final}
time:   00:27:29
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601014/

[6601016] rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final}
time:   00:17:46
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601016/

[6601017] rados:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all}
time:   00:10:56
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601017/

[6601018] rados:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start}
time:   00:19:59
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601018/

[6601020] rados:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:35:41
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601020/

[6601021] rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}}
time:   00:28:23
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601021/

[6601022] rados:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity}
time:   00:29:05
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601022/

[6601023] rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final}
time:   00:18:13
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601023/

[6601024] rados:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start}
time:   00:19:19
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601024/

[6601026] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos}
time:   00:06:27
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601026/

[6601027] rados:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add}
time:   00:17:34
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601027/

[6601028] rados:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root}
time:   00:36:13
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601028/

[6601033] rados:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:23:50
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601033/

[6601035] rados:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final}
time:   00:15:10
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601035/

[6601036] rados:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag}
time:   00:18:07
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601036/

[6601037] rados:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start}
time:   00:17:29
info:   http://pulpito.ceph.com/gabrioux-2022-01-07_12:26:52-rados:cephadm-wip-guits-testing-2022-01-07-0853-pacific-distro-default-smithi/6601037/