2022-04-04T11:45:12.700 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-04T11:45:12.703 INFO:teuthology.results:subset: '1/999' 2022-04-04T11:45:12.703 INFO:teuthology.results:seed: '1251' 2022-04-04T12:19:52.116 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-04T12:19:52.140 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-04T13:05:55.478 INFO:teuthology.results:Tests finished! gathering results... 2022-04-04T13:05:59.300 INFO:scrape:Found 65 jobs 2022-04-04T13:06:03.285 INFO:scrape:Found 3 distinct failure reasons 2022-04-04T13:06:03.286 INFO:scrape:Failure: No module named 'tasks' 2022-04-04T13:06:03.287 INFO:scrape:5 jobs: ['6776206', '6776200', '6776201', '6776207', '6776205'] 2022-04-04T13:06:03.287 INFO:scrape:suites intersection: [] 2022-04-04T13:06:03.288 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/basic', '2-thrash', '3-final}', '3-tasks/small-objects', 'agent/on', 'fixed-2', 'mode/packaged', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async-v1only', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools}', 'orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{agent/off', 'root}', 'start', 'start}', 'task/test_cephadm_repos}', 'tasks/rados_api_tests}'] 2022-04-04T13:06:03.288 INFO:scrape: 2022-04-04T13:06:03.288 INFO:scrape:Failure: Command failed on smithi062 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" 2022-04-04T13:06:03.289 INFO:scrape:10 jobs: ['6776256', '6776196', '6776221', '6776258', '6776259', '6776246', '6776210', '6776248', '6776234', '6776211'] 2022-04-04T13:06:03.289 INFO:scrape:suites intersection: [] 2022-04-04T13:06:03.290 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-inline/yes', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fixed-2', 'mds', 'mode/packaged', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v2only', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{agent/off', 'orch:cephadm/workunits/{agent/on', 'osd}', 'overrides/{pg-warn', 'roles', 'start', 'syntax', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'test_iscsi_pids_limit}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-04T13:06:03.290 INFO:scrape: 2022-04-04T13:06:03.291 INFO:scrape:Failure: Command failed on smithi106 with status 5: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server'" 2022-04-04T13:06:03.291 INFO:scrape:6 jobs: ['6776208', '6776202', '6776225', '6776228', '6776247', '6776222'] 2022-04-04T13:06:03.292 INFO:scrape:suites intersection: ['1-start'] 2022-04-04T13:06:03.292 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-start', '2-nfs', '2-services/nfs', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs2', '3-final}', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun'] 2022-04-04T13:06:03.292 INFO:scrape: 2022-04-04T13:06:03.295 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/ failed: 21 dead: 0 running: 0 waiting: 0 queued: 0 passed: 44 Fail ================================================================= [6776196] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:12:16 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776196/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776196/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa5c110bae094d45912114cfbcfa7567 Command failed on smithi156 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" [6776200] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:05:28 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776200/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776200/ sentry: https://sentry.ceph.com/organizations/ceph/?query=154ebf7752dc40959e2dedc636b9cd66 No module named 'tasks.cephadm' [6776201] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:05:35 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776201/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776201/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bb46ebd2ea1a461abd00b02113f71aca No module named 'tasks.cephadm' [6776202] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:08:18 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776202/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776202/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82183db5684940d9ac91dc9a685934f8 Command failed on smithi139 with status 5: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server'" [6776205] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:02:32 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776205/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776205/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6cec224ffeba4c08b5c03115ce001a9b No module named 'tasks' [6776206] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:02:00 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776206/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776206/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5de3abd7af42491faf9a1365b82d7aba No module named 'tasks' [6776207] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:06:17 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776207/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776207/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e00f23c3f6d749f6bf294bf276f06ba5 No module named 'tasks' [6776208] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:09:00 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776208/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776208/ sentry: https://sentry.ceph.com/organizations/ceph/?query=075b36ce78f1493e88e5c736d036adde Command failed on smithi106 with status 5: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server'" [6776210] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:14:08 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776210/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776210/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c4dd75292184b6fb5d48ce26a5be3f9 Command failed on smithi124 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" [6776211] orch:cephadm/workunits/{agent/on mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:10:04 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776211/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776211/ sentry: https://sentry.ceph.com/organizations/ceph/?query=73d1da30349a4c8284f4a03e70df3c6b Command failed on smithi084 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6776221] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:12:36 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776221/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776221/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c2a35d089b87491d8b63ad4f840f85bc Command failed on smithi067 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" [6776222] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:09:25 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776222/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776222/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a657d5ab0ee64bab9af571e748eaec03 Command failed on smithi135 with status 5: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server'" [6776225] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:08:44 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776225/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776225/ sentry: https://sentry.ceph.com/organizations/ceph/?query=93f9d62d30284a788bf17c8c8c50c73f Command failed on smithi018 with status 5: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server'" [6776228] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:08:53 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776228/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776228/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c6b459d37b3444cf9eabf581189e910f Command failed on smithi133 with status 5: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server'" [6776234] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:12:11 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776234/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776234/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1db2aff9e95e42eebf6cdfb77327ef1c Command failed on smithi089 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" [6776246] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:14:37 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776246/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776246/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5ce4787933f34ff9b45aaaf23de00ab4 Command failed on smithi016 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6776247] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776247/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776247/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2d6027d5a016428aab87d7880d6b380e Command failed on smithi085 with status 5: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server'" [6776248] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:14:09 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776248/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776248/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72f5bdf21d8943b9bea1845c99261e60 Command failed on smithi087 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" [6776256] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:14:45 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776256/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776256/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4b35b4b03db24783a88915a2036cd569 Command failed on smithi062 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6776258] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:12:15 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776258/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776258/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f11c8e1ad40843dbaf03f1a40d0d8b3f Command failed on smithi007 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" [6776259] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:10:40 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776259/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776259/ sentry: https://sentry.ceph.com/organizations/ceph/?query=693087b69cff4939b1524c3a06302f5e Command failed on smithi187 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" Pass ================================================================= [6776197] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:11:23 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776197/ [6776198] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:29:00 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776198/ [6776199] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:11:25 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776199/ [6776203] orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/off orchestrator_cli} time: 00:10:33 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776203/ [6776204] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:26:48 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776204/ [6776209] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:09:55 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776209/ [6776212] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:16:15 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776212/ [6776213] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:47:09 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776213/ [6776214] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:33:13 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776214/ [6776215] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:46 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776215/ [6776216] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:09 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776216/ [6776217] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:29:14 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776217/ [6776218] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} time: 00:26:01 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776218/ [6776219] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:27 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776219/ [6776220] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:00 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776220/ [6776223] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:41:48 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776223/ [6776224] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:57 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776224/ [6776226] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:17:51 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776226/ [6776227] orch:cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} time: 00:13:49 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776227/ [6776229] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:13:48 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776229/ [6776230] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:18:26 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776230/ [6776231] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:22:52 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776231/ [6776232] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:51:22 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776232/ [6776233] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:25:03 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776233/ [6776235] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} time: 00:22:49 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776235/ [6776236] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:10:53 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776236/ [6776237] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:14:20 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776237/ [6776238] orch:cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:06:32 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776238/ [6776239] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:14:45 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776239/ [6776240] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:38 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776240/ [6776241] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:13:00 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776241/ [6776242] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} time: 00:14:42 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776242/ [6776243] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:10:57 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776243/ [6776244] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:09:43 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776244/ [6776245] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:26:32 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776245/ [6776249] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:10:05 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776249/ [6776250] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:29:49 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776250/ [6776251] orch:cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:03:17 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776251/ [6776252] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:06 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776252/ [6776253] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:17 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776253/ [6776254] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:19 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776254/ [6776255] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:32:42 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776255/ [6776257] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:14:51 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776257/ [6776260] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:09:40 info: http://pulpito.ceph.com/gabrioux-2022-04-04_11:40:32-orch:cephadm-wip-guits-testing-2022-04-04-0933-distro-default-smithi/6776260/