2021-11-18T18:45:33.534 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-18T18:45:33.536 INFO:teuthology.results:subset: '1/999' 2021-11-18T18:45:33.536 INFO:teuthology.results:seed: '5803' 2021-11-18T20:01:40.073 INFO:root:teuthology version: 1.1.0-6cfddd5e 2021-11-18T20:01:40.108 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-11-19T07:49:38.261 INFO:teuthology.results:Tests finished! gathering results... 2021-11-19T07:49:47.448 INFO:scrape:Found 90 jobs 2021-11-19T07:49:51.312 INFO:scrape:Found 6 distinct failure reasons 2021-11-19T07:49:51.313 INFO:scrape:Failure: SSH connection to smithi098 was lost: 'uname -r' 2021-11-19T07:49:51.313 INFO:scrape:9 jobs: ['6512250', '6512246', '6512243', '6512275', '6512266', '6512260', '6512234', '6512270', '6512235'] 2021-11-19T07:49:51.314 INFO:scrape:suites intersection: [] 2021-11-19T07:49:51.315 INFO:scrape:suites union: ['0-nvme-loop', '1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/octopus', '1-start', '2-services/nfs2', '3-final}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados:cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}'] 2021-11-19T07:49:51.315 INFO:scrape: 2021-11-19T07:49:51.316 INFO:scrape:Failure: Command failed on smithi063 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' 2021-11-19T07:49:51.317 INFO:scrape:4 jobs: ['6512268', '6512271', '6512228', '6512207'] 2021-11-19T07:49:51.318 INFO:scrape:suites intersection: [] 2021-11-19T07:49:51.319 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', 'distro/ubuntu_18.04', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'rados:cephadm/osds/{0-distro/ubuntu_18.04', 'rados:cephadm/smoke/{0-nvme-loop', 'start}'] 2021-11-19T07:49:51.319 INFO:scrape: 2021-11-19T07:49:51.320 INFO:scrape:Dead: b'2021-11-19T07:12:56.790 DEBUG:teuthology.exit:Finished running handlers' 2021-11-19T07:49:51.321 INFO:scrape:4 jobs: ['6512218', '6512238', '6512262', '6512193'] 2021-11-19T07:49:51.322 INFO:scrape:suites intersection: ['1-volume/{0-create', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'roles', 'tasks/{0-v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-11-19T07:49:51.323 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-upgrade-with-workload', '3-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'roles', 'tasks/{0-v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-11-19T07:49:51.323 INFO:scrape: 2021-11-19T07:49:51.324 INFO:scrape:Failure: Command failed on smithi114 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2021-11-19T07:49:51.325 INFO:scrape:3 jobs: ['6512226', '6512255', '6512194'] 2021-11-19T07:49:51.326 INFO:scrape:suites intersection: ['0-centos_8.stream_container_tools', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados:cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0'] 2021-11-19T07:49:51.326 INFO:scrape:suites union: ['0-centos_8.stream_container_tools', '1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'rados:cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0'] 2021-11-19T07:49:51.327 INFO:scrape: 2021-11-19T07:49:51.327 INFO:scrape:Failure: Command failed on smithi016 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 571f08fc-48a3-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi016:vg_nvme/lv_4' 2021-11-19T07:49:51.328 INFO:scrape:10 jobs: ['6512205', '6512230', '6512209', '6512236', '6512256', '6512189', '6512200', '6512220', '6512213', '6512223'] 2021-11-19T07:49:51.328 INFO:scrape:suites intersection: [] 2021-11-19T07:49:51.329 INFO:scrape:suites union: ['1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mode/packaged', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'rados', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados:cephadm/with-work/{0-distro/ubuntu_18.04', 'start', 'tasks/rados_api_tests}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2021-11-19T07:49:51.329 INFO:scrape: 2021-11-19T07:49:51.330 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi074 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e77c7dee6c987c6680b57de9907bbc4d4962f2b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-11-19T07:49:51.330 INFO:scrape:1 jobs: ['6512192'] 2021-11-19T07:49:51.330 INFO:scrape:suites: ['rados:cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0', 'task/test_e2e}'] 2021-11-19T07:49:51.331 INFO:scrape: 2021-11-19T07:49:51.335 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/ failed: 18 dead: 13 running: 0 waiting: 0 queued: 0 passed: 59 Fail ================================================================= [6512189] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:09:15 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512189/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c92664ade150495794971d48584f4e15 Command failed on smithi012 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ee11f1fe-48a1-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi012:vg_nvme/lv_4' [6512192] rados:cephadm/dashboard/{0-distro/centos_8.3_container_tools_3.0 task/test_e2e} ----------------------------------------------------------------- time: 00:19:35 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512192/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512192/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cbf05a361d9443238b6b046ff25ff20f Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi074 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e77c7dee6c987c6680b57de9907bbc4d4962f2b1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [6512194] rados:cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:06:24 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512194/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512194/ sentry: https://sentry.ceph.com/organizations/ceph/?query=57a45b9795614e4abcec05a7bfa856c6 Command failed on smithi204 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6512200] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:08:58 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512200/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512200/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99c006f3c3314bed93b651c0fec72b3b Command failed on smithi036 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0265a30-48a2-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi036:vg_nvme/lv_4' [6512205] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:08:48 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512205/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512205/ sentry: https://sentry.ceph.com/organizations/ceph/?query=29d31917b29c42768bddccc421740ab2 Command failed on smithi016 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 571f08fc-48a3-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi016:vg_nvme/lv_4' [6512207] rados:cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:03:19 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512207/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512207/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82dd6a6e548c461095529184dd367950 Command failed on smithi089 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6512209] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:09:33 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512209/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512209/ sentry: https://sentry.ceph.com/organizations/ceph/?query=746dc432bc3e4579b88b20eb276d9f86 Command failed on smithi033 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fdb7408a-48a3-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi033:vg_nvme/lv_4' [6512213] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:09:48 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512213/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512213/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4106197a4f7e4fe3a93ac52c1714cf98 Command failed on smithi133 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 655f397c-48a4-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi133:vg_nvme/lv_4' [6512220] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:09:34 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512220/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512220/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f177990eef8f4cb6968ce49a329648ab Command failed on smithi077 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 48d9a174-48a5-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi077:vg_nvme/lv_4' [6512223] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:11:15 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512223/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd76268ce131455e8b03770469410bec Command failed on smithi035 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 794ab60e-48a5-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi035:vg_nvme/lv_4' [6512226] rados:cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:06:23 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512226/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2e256e21489d44e7af07ced5e64affb8 Command failed on smithi114 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6512228] rados:cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:20 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512228/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512228/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ab9eed0bb044c5c9b55102396f551a9 Command failed on smithi089 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6512230] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:09:19 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512230/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a1e81697954c4d5eb02350a0cccad6e2 Command failed on smithi016 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 09f7a61c-48a6-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi016:vg_nvme/lv_4' [6512236] rados:cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:08:54 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512236/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512236/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11e5222427d84321aab42ee6f2cc8a47 Command failed on smithi033 with status 22: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bba2b230-48a6-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi033:vg_nvme/lv_4' [6512255] rados:cephadm/mgr-nfs-upgrade/{0-centos_8.3_container_tools_3.0 0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:06:22 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512255/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512255/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b6640d1f7ba24bfea5f698c6cfefc9b3 Command failed on smithi185 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [6512256] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:09:43 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512256/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512256/ sentry: https://sentry.ceph.com/organizations/ceph/?query=43389c16a83a415cb01d8b0e151f3f21 Command failed on smithi035 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:e77c7dee6c987c6680b57de9907bbc4d4962f2b1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid af09d880-48a8-11ec-8c2c-001a4aab830c -- ceph orch daemon add osd smithi035:vg_nvme/lv_4' [6512268] rados:cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:03:22 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512268/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512268/ sentry: https://sentry.ceph.com/organizations/ceph/?query=67af9532fbba4ba182a49b742fc3a914 Command failed on smithi063 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' [6512271] rados:cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:03:27 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512271/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512271/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f23b5cafde2d4d1fa06101a3f761c4ab Command failed on smithi058 with status 251: 'sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1 && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/attr_allow_any_host && sudo mkdir -p /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1 && echo /dev/vg_nvme/lv_1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/device_path && echo 1 | sudo tee /sys/kernel/config/nvmet/subsystems/lv_1/namespaces/1/enable && sudo ln -s /sys/kernel/config/nvmet/subsystems/lv_1 /sys/kernel/config/nvmet/ports/1/subsystems/lv_1 && sudo nvme connect -t loop -n lv_1 -q hostnqn' Dead ================================================================= [6512193] rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512193/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512193/ hit max job timeout [6512218] rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512218/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512218/ hit max job timeout [6512234] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512234/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512234/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cd7fd61f7cd14b8bb584d7f05b46f568 SSH connection to smithi173 was lost: 'uname -r' [6512235] rados:cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512235/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512235/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3fe6c99aabcd44c393b8a1761b8058c0 SSH connection to smithi057 was lost: 'uname -r' [6512238] rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512238/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512238/ hit max job timeout [6512243] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512243/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512243/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d9c8f616d8ed421c90132ef94534743e SSH connection to smithi170 was lost: 'uname -r' [6512246] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512246/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ec6f7262978412786548e9632966afd SSH connection to smithi167 was lost: 'uname -r' [6512250] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512250/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512250/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e00928df4bb74d6f8adbba0f8d12af7e SSH connection to smithi098 was lost: 'uname -r' [6512260] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512260/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512260/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f017825e174e4290a3d2b9df3d3cae9a SSH connection to smithi173 was lost: 'uname -r' [6512262] rados:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512262/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512262/ hit max job timeout [6512266] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512266/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512266/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a9bed865656f4ff3bc2653dbe7b30c8c SSH connection to smithi105 was lost: 'uname -r' [6512270] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512270/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512270/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0e02545e37746358ca97bce1c95a5f0 SSH connection to smithi136 was lost: 'uname -r' [6512275] rados:cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512275/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512275/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0467f4770e1640dd94d7175f1f17f887 SSH connection to smithi086 was lost: 'uname -r' Pass ================================================================= [6512188] rados:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:52 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512188/ [6512190] rados:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:35:36 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512190/ [6512191] rados:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:31:37 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512191/ [6512195] rados:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:14:45 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512195/ [6512196] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:36 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512196/ [6512197] rados:cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:16:43 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512197/ [6512198] rados:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:30:01 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512198/ [6512199] rados:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:14:21 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512199/ [6512201] rados:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:29 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512201/ [6512202] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:08:14 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512202/ [6512203] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:15:48 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512203/ [6512204] rados:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:07 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512204/ [6512206] rados:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:23:05 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512206/ [6512208] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:14:37 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512208/ [6512210] rados:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:14:47 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512210/ [6512211] rados:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:36:12 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512211/ [6512212] rados:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:23:11 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512212/ [6512214] rados:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:01 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512214/ [6512215] rados:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:15 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512215/ [6512216] rados:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:45:50 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512216/ [6512217] rados:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:15:12 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512217/ [6512219] rados:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:11 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512219/ [6512221] rados:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:19:54 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512221/ [6512222] rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:23 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512222/ [6512224] rados:cephadm/osds/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:10 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512224/ [6512225] rados:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:34:57 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512225/ [6512227] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:13:59 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512227/ [6512229] rados:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:34:49 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512229/ [6512231] rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:56 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512231/ [6512232] rados:cephadm/osds/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:15 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512232/ [6512233] rados:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:56 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512233/ [6512237] rados:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:48:34 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512237/ [6512239] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:14:42 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512239/ [6512240] rados:cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:17:30 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512240/ [6512241] rados:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:25:39 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512241/ [6512242] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:12:03 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512242/ [6512244] rados:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:13:07 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512244/ [6512245] rados:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:18:27 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512245/ [6512247] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:46 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512247/ [6512248] rados:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:25:12 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512248/ [6512249] rados:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:39 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512249/ [6512251] rados:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:52 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512251/ [6512252] rados:cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:14:42 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512252/ [6512253] rados:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm} time: 00:16:22 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512253/ [6512254] rados:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:31:34 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512254/ [6512257] rados:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:12:52 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512257/ [6512258] rados:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:37 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512258/ [6512259] rados:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:20:15 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512259/ [6512261] rados:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:34:56 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512261/ [6512263] rados:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:29 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512263/ [6512264] rados:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:19:45 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512264/ [6512265] rados:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:12:52 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512265/ [6512267] rados:cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:08:04 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512267/ [6512269] rados:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:37:34 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512269/ [6512272] rados:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:38 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512272/ [6512273] rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:17:43 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512273/ [6512274] rados:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:26 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512274/ [6512276] rados:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:18:06 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512276/ [6512277] rados:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:18:17 info: http://pulpito.ceph.com/gabrioux-2021-11-18_15:57:43-rados:cephadm-wip-guits-testing-2021-11-18-1333-pacific-distro-default-smithi/6512277/