2022-08-18T07:49:24.878 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1 2022-08-18T07:49:24.880 INFO:teuthology.results:subset: '1/6' 2022-08-18T07:49:24.880 INFO:teuthology.results:seed: '5034' 2022-08-18T08:53:06.796 INFO:root:teuthology version: 1.1.1.dev412+gb1d387f1 2022-08-18T08:53:06.823 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-08-18T09:47:11.489 INFO:teuthology.results:Tests finished! gathering results... 2022-08-18T09:47:19.090 INFO:scrape:Found 100 jobs 2022-08-18T09:47:19.685 INFO:scrape:Found 3 distinct failure reasons 2022-08-18T09:47:19.687 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=9f9489f34f5b1025afff03f86242be5f122c42bd 2022-08-18T09:47:19.688 INFO:scrape:4 jobs: ['6978119', '6978094', '6978083', '6978110'] 2022-08-18T09:47:19.689 INFO:scrape:suites intersection: [] 2022-08-18T09:47:19.690 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/workunits/{agent/off', 'orch:cephadm/workunits/{agent/on', 'task/test_adoption}', 'task/test_cephadm}', 'task/test_nfs}', 'task/test_orch_cli}'] 2022-08-18T09:47:19.690 INFO:scrape: 2022-08-18T09:47:19.691 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9f9489f34f5b1025afff03f86242be5f122c42bd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' 2022-08-18T09:47:19.691 INFO:scrape:2 jobs: ['6978060', '6978132'] 2022-08-18T09:47:19.693 INFO:scrape:suites intersection: ['task/test_cephadm_repos}'] 2022-08-18T09:47:19.693 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/workunits/{agent/off', 'orch:cephadm/workunits/{agent/on', 'task/test_cephadm_repos}'] 2022-08-18T09:47:19.694 INFO:scrape: 2022-08-18T09:47:19.694 INFO:scrape:Failure: Command failed on smithi093 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:9f9489f34f5b1025afff03f86242be5f122c42bd pull' 2022-08-18T09:47:19.695 INFO:scrape:1 jobs: ['6978148'] 2022-08-18T09:47:19.695 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0'] 2022-08-18T09:47:19.696 INFO:scrape: 2022-08-18T09:47:19.699 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/ failed: 7 dead: 0 running: 0 waiting: 0 queued: 0 passed: 93 Fail ================================================================= [6978060] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:05:31 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978060/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978060/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b13f899a8605401fbc3d265752e3dfa4 Command failed (workunit test cephadm/test_repos.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9f9489f34f5b1025afff03f86242be5f122c42bd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [6978083] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:04:45 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978083/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978083/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6b24f7b2ab6945698047b992756e784e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =9f9489f34f5b1025afff03f86242be5f122c42bd [6978094] orch:cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:06:38 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978094/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978094/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bfba5ad18dad472d8d7333e9ea2a88f7 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =9f9489f34f5b1025afff03f86242be5f122c42bd [6978110] orch:cephadm/workunits/{agent/on mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:04:42 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978110/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978110/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f243e4c3dcf54e79a67705bc83e9b916 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =9f9489f34f5b1025afff03f86242be5f122c42bd [6978119] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:04:40 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978119/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978119/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a678839ab172484d9e83110d44e05363 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1 =9f9489f34f5b1025afff03f86242be5f122c42bd [6978132] orch:cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:05:22 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978132/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978132/ sentry: https://sentry.ceph.com/organizations/ceph/?query=238d32a0561b41a0a1376a8037d82dbe Command failed (workunit test cephadm/test_repos.sh) on smithi204 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9f9489f34f5b1025afff03f86242be5f122c42bd TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [6978148] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:41:45 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978148/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978148/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ddbf7f06fa144c95a2c00be6be6316b4 Command failed on smithi093 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:9f9489f34f5b1025afff03f86242be5f122c42bd pull' Pass ================================================================= [6978050] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:23 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978050/ [6978051] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:14:03 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978051/ [6978052] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:31:20 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978052/ [6978053] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} time: 00:19:02 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978053/ [6978054] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:26:32 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978054/ [6978055] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:09:53 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978055/ [6978056] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:29:05 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978056/ [6978057] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:31:25 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978057/ [6978058] orch:cephadm/upgrade_without_reducing_max_mds/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:47:53 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978058/ [6978059] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:33:33 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978059/ [6978061] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:16:36 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978061/ [6978062] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:45 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978062/ [6978063] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:21:07 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978063/ [6978064] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:40 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978064/ [6978065] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:27 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978065/ [6978066] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:35:13 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978066/ [6978067] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:39:59 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978067/ [6978068] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:21:32 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978068/ [6978069] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:57 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978069/ [6978070] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:43:40 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978070/ [6978071] orch:cephadm/workunits/{agent/on mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:12:03 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978071/ [6978072] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:27:11 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978072/ [6978073] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:12:48 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978073/ [6978074] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:23 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978074/ [6978075] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:56 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978075/ [6978076] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:11:00 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978076/ [6978077] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:39:31 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978077/ [6978078] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:41:41 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978078/ [6978079] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:16:49 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978079/ [6978080] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:30:46 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978080/ [6978081] orch:cephadm/upgrade_without_reducing_max_mds/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:48:06 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978081/ [6978082] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:22:05 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978082/ [6978084] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:55 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978084/ [6978085] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:53:28 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978085/ [6978086] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:33:36 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978086/ [6978087] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:01 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978087/ [6978088] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:36 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978088/ [6978089] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:07 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978089/ [6978090] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:16:29 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978090/ [6978091] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:22:35 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978091/ [6978092] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:59 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978092/ [6978093] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:52:38 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978093/ [6978095] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:11:41 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978095/ [6978096] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:41:53 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978096/ [6978097] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:39:08 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978097/ [6978098] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:12:31 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978098/ [6978099] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:29 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978099/ [6978100] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:28:50 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978100/ [6978101] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:36 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978101/ [6978102] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:29 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978102/ [6978103] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} time: 00:18:53 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978103/ [6978104] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:49 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978104/ [6978105] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:16:07 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978105/ [6978106] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:35:27 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978106/ [6978107] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:43:27 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978107/ [6978108] orch:cephadm/upgrade_without_reducing_max_mds/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:48:05 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978108/ [6978109] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:33:45 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978109/ [6978111] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:19:20 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978111/ [6978112] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:21:10 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978112/ [6978113] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:10:50 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978113/ [6978114] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:57 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978114/ [6978115] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:33:24 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978115/ [6978116] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:40:09 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978116/ [6978117] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:11:08 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978117/ [6978118] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:32:21 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978118/ [6978120] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:56 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978120/ [6978121] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:26:40 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978121/ [6978122] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:11:01 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978122/ [6978123] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:32:53 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978123/ [6978124] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:41 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978124/ [6978125] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:46 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978125/ [6978126] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:57:20 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978126/ [6978127] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:40:59 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978127/ [6978128] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:20:02 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978128/ [6978129] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:51:57 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978129/ [6978130] orch:cephadm/upgrade_without_reducing_max_mds/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:48:13 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978130/ [6978131] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:21:23 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978131/ [6978133] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:17:31 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978133/ [6978134] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:30 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978134/ [6978135] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:20:09 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978135/ [6978136] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:14:50 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978136/ [6978137] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:34:03 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978137/ [6978138] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:33:43 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978138/ [6978139] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:11:23 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978139/ [6978140] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:27:18 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978140/ [6978141] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:54 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978141/ [6978142] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:24:20 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978142/ [6978143] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:12:22 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978143/ [6978144] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:10:48 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978144/ [6978145] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:47:25 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978145/ [6978146] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:39:10 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978146/ [6978147] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:16:14 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978147/ [6978149] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:29 info: http://pulpito.ceph.com/adking-2022-08-18_01:28:05-orch:cephadm-wip-adk-testing-2022-08-17-1914-distro-default-smithi/6978149/