2023-07-11T13:18:50.626 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T13:18:50.627 INFO:teuthology.results:subset: '1/14' 2023-07-11T13:18:50.627 INFO:teuthology.results:seed: '172' 2023-07-11T14:19:33.936 INFO:root:teuthology version: 0.0.1.dev140+gb53f236 2023-07-11T14:19:33.961 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-11T14:59:37.489 INFO:teuthology.results:Tests finished! gathering results... 2023-07-11T14:59:41.669 INFO:scrape:Found 93 jobs 2023-07-11T14:59:45.657 INFO:scrape:Found 2 distinct failure reasons 2023-07-11T14:59:45.658 INFO:scrape:Failure: Command failed on smithi046 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6b395a6-1ff9-11ee-9b31-001a4aab830c -- ceph orch host add smithi073' 2023-07-11T14:59:45.659 INFO:scrape:68 jobs 2023-07-11T14:59:45.659 INFO:scrape:suites intersection: [] 2023-07-11T14:59:45.660 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-services/basic', '2-services/client-keyring', '2-services/iscsi', '2-services/jaeger', '2-services/mirror', '2-services/nfs', '2-services/nfs-haproxy-proto', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs-keepalive-only', '2-services/nfs2', '2-services/rgw', '2-services/rgw-ingress', '2-thrash', '3-final}', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', 'agent/off', 'agent/on', 'base/install', 'cluster/{fixed-3', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'openstack}', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/osds/{0-distro/ubuntu_20.04', 'orch:cephadm/rbd_iscsi/{0-single-container-host', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/smoke/{0-distro/ubuntu_20.04', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/thrash/{0-distro/ubuntu_20.04', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'root}', 'start', 'start}', 'task/test_monitoring_stack_basic}', 'task/test_orch_cli_mon}', 'task/test_rgw_multisite}', 'task/test_set_mon_crush_locations}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'tasks/rotate-keys}', 'workloads/cephadm_iscsi}'] 2023-07-11T14:59:45.660 INFO:scrape: 2023-07-11T14:59:45.661 INFO:scrape:Failure: Test failure: test_error (tasks.mgr.test_orchestrator_cli.TestOrchestratorCli) 2023-07-11T14:59:45.661 INFO:scrape:2 jobs: ['7333796', '7333750'] 2023-07-11T14:59:45.661 INFO:scrape:suites intersection: ['2-node-mgr', 'orchestrator_cli}'] 2023-07-11T14:59:45.662 INFO:scrape:suites union: ['2-node-mgr', 'agent/off', 'agent/on', 'orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun}', 'orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0}', 'orchestrator_cli}'] 2023-07-11T14:59:45.662 INFO:scrape: 2023-07-11T14:59:45.667 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/ failed: 70 dead: 0 running: 0 waiting: 0 queued: 0 passed: 23 Fail ================================================================= [7333744] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:17:44 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333744/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333744/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3159e742b02540148e135a5b88b540c1 Command failed on smithi042 with status 22: 'sudo cephadm --image quay- quay-quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8a0ceca4-1ff0-11ee-9b31-001a4aab830c -- ceph orch host add smithi104' [7333745] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:10:10 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333745/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333745/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ce0e83417065482eaafde0cc17304b18 Command failed on smithi116 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e852d0b8-1fef-11ee-9b31-001a4aab830c -- ceph orch host add smithi152' [7333746] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:12:36 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333746/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333746/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b34c9ebbbe3f40e28c88aa18d91bfc99 Command failed on smithi033 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d4aa278c-1fef-11ee-9b31-001a4aab830c -- ceph orch host add smithi184' [7333747] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:09:50 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333747/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333747/ sentry: https://sentry.ceph.com/organizations/ceph/?query=26e017222db24720946db17460129737 Command failed on smithi100 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f3d0b144-1fef-11ee-9b31-001a4aab830c -- ceph orch host add smithi136' [7333748] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_monitoring_stack_basic} ----------------------------------------------------------------- time: 00:20:56 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333748/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333748/ sentry: https://sentry.ceph.com/organizations/ceph/?query=75201ad10e91457485beb013c721ab6f Command failed on smithi061 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e242d752-1ff1-11ee-9b31-001a4aab830c -- ceph orch host add smithi172' [7333750] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} ----------------------------------------------------------------- time: 00:23:19 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333750/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333750/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84ccb86cc5d04401a693d768f0ef5539 Test failure: test_error (tasks.mgr.test_orchestrator_cli.TestOrchestratorCli) [7333751] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:10:06 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333751/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333751/ sentry: https://sentry.ceph.com/organizations/ceph/?query=084f8a4af39a492c9928495ff1be3b7b Command failed on smithi003 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cdc05926-1ff1-11ee-9b31-001a4aab830c -- ceph orch host add smithi086' [7333753] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:10:40 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333753/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333753/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fc9481dc99f3477aabfa7f27caa1bd72 Command failed on smithi027 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d6f012d4-1ff1-11ee-9b31-001a4aab830c -- ceph orch host add smithi079' [7333754] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:18:43 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333754/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333754/ sentry: https://sentry.ceph.com/organizations/ceph/?query=566e1f209aa8420ca5b40940e42e7da8 Command failed on smithi046 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 pull' [7333755] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:10:32 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333755/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333755/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3367fc93bec34716982f9a3d6c5ed02c Command failed on smithi132 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid dd7e016a-1ff1-11ee-9b31-001a4aab830c -- ceph orch host add smithi159' [7333756] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:14:13 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333756/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333756/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b61fb50f0fde4d1891d82f9a6799ced4 Command failed on smithi050 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6344509c-1ff2-11ee-9b31-001a4aab830c -- ceph orch host add smithi148' [7333758] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:11:50 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333758/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333758/ sentry: https://sentry.ceph.com/organizations/ceph/?query=96ccdef870ea49d4b36a5a294f56188f Command failed on smithi097 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8d44f424-1ff1-11ee-9b31-001a4aab830c -- ceph orch host add smithi121' [7333759] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:12:30 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333759/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333759/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f5cf6b398d5c4bda8ed1cf659d3d2adb Command failed on smithi090 with status 22: 'sudo cephadm --image quay- quay-quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 760feb78-1ff2-11ee-9b31-001a4aab830c -- ceph orch host add smithi177' [7333761] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:12:13 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333761/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333761/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f29bc4d6275e4c38bd3c30ef17514061 Command failed on smithi131 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3e263c1c-1ff2-11ee-9b31-001a4aab830c -- ceph orch host add smithi182' [7333762] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:15:26 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333762/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333762/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a4e22977732d4cd782ee2d29134c98e9 Command failed on smithi116 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f4a9a410-1ff2-11ee-9b31-001a4aab830c -- ceph orch host add smithi152' [7333763] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:11:54 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333763/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333763/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e96a7360afee4282a676763f573054d8 Command failed on smithi033 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b291914-1ff2-11ee-9b31-001a4aab830c -- ceph orch host add smithi184' [7333766] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} ----------------------------------------------------------------- time: 00:11:06 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333766/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333766/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eb3fd96139e14812ab7ffc5358d89d85 Command failed on smithi069 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a4cdcb2-1ff2-11ee-9b31-001a4aab830c -- ceph orch host add smithi145' [7333767] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:16:26 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333767/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333767/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d8837cabfb4c4621a82b901b1c551aaf Command failed on smithi136 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c048c4ca-1ff3-11ee-9b31-001a4aab830c -- ceph orch host add smithi137' [7333768] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:20:23 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333768/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333768/ sentry: https://sentry.ceph.com/organizations/ceph/?query=93ef690ee1dc43a58183d4b1887285b2 Command failed on smithi008 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5be4c988-1ff4-11ee-9b31-001a4aab830c -- ceph orch host add smithi123' [7333769] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:18:24 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333769/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333769/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e7d236c7559a4eb1bfbca2a3dc790f7a Command failed on smithi118 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 456f8e8a-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi140' [7333770] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:10:42 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333770/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333770/ sentry: https://sentry.ceph.com/organizations/ceph/?query=624fe24298394076a4124c970828904e Command failed on smithi099 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4b9d36f6-1ff3-11ee-9b31-001a4aab830c -- ceph orch host add smithi112' [7333771] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:21:20 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333771/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333771/ sentry: https://sentry.ceph.com/organizations/ceph/?query=958090b525c44a46890e3a9f94324687 Command failed on smithi032 with status 22: 'sudo cephadm --image quay- quay-quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cbd15946-1ff4-11ee-9b31-001a4aab830c -- ceph orch host add smithi151' [7333772] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:10:39 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333772/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333772/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1a0a9698b9364e0fa7c46049157c4f26 Command failed on smithi083 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6846f59e-1ff3-11ee-9b31-001a4aab830c -- ceph orch host add smithi107' [7333773] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:11:26 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333773/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333773/ sentry: https://sentry.ceph.com/organizations/ceph/?query=596dd656c4f847a9972bf24e077686af Command failed on smithi101 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0f220b70-1ff3-11ee-9b31-001a4aab830c -- ceph orch host add smithi155' [7333774] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:46 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333774/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333774/ sentry: https://sentry.ceph.com/organizations/ceph/?query=61c02f688b634092be784bbf19352e9c Command failed on smithi042 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3518b66c-1ff3-11ee-9b31-001a4aab830c -- ceph orch host add smithi104' [7333775] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:09:46 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333775/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333775/ sentry: https://sentry.ceph.com/organizations/ceph/?query=234e03285c954f6a8903be05c4cbd212 Command failed on smithi134 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 939d8252-1ff4-11ee-9b31-001a4aab830c -- ceph orch host add smithi191' [7333776] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:27:15 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333776/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333776/ sentry: https://sentry.ceph.com/organizations/ceph/?query=993e156b040e4bb6bda9158ab6a076db Command failed on smithi006 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bd093e00-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi055' [7333777] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:15:16 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333777/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333777/ sentry: https://sentry.ceph.com/organizations/ceph/?query=56c56bd62cab44f2b0d1c5d0d8a6bde2 Command failed on smithi088 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f0355be-1ff4-11ee-9b31-001a4aab830c -- ceph orch host add smithi202' [7333778] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:13:20 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333778/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333778/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c7838ca480e4056b0e79beb4a004e58 Command failed on smithi038 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid df49f042-1ff3-11ee-9b31-001a4aab830c -- ceph orch host add smithi070' [7333781] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:18:55 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333781/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333781/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8b6fea95c2c34af5a8accf2ef65dfe63 Command failed on smithi005 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b617de40-1ff4-11ee-9b31-001a4aab830c -- ceph orch host add smithi171' [7333782] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:22:31 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333782/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333782/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3b84ee55ac39402caf8e428c72ab9163 Command failed on smithi097 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f0dcb27a-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi121' [7333784] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:15:01 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333784/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333784/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b72a3bdeec5c49cfac41f3c176b17947 Command failed on smithi027 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 388778f4-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi160' [7333785] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:19:05 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333785/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333785/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06827ad2ba9a466ca6c1fa4dd15328bb Command failed on smithi079 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ace1894c-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi172' [7333786] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:10:07 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333786/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333786/ sentry: https://sentry.ceph.com/organizations/ceph/?query=22e4dd1b62824290b246e6088ef90cec Command failed on smithi003 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7dcf9bc-1ff4-11ee-9b31-001a4aab830c -- ceph orch host add smithi092' [7333787] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:13:03 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333787/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333787/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bc1d62cf40cb442493e9333593329014 Command failed on smithi061 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid cbde4e12-1ff4-11ee-9b31-001a4aab830c -- ceph orch host add smithi190' [7333788] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:21:02 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333788/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333788/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7fc51e8c09d247d385076840c1cd0bc9 Command failed on smithi132 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0a9db97a-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi159' [7333789] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:21:48 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333789/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333789/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b1c0d883a4a248aca7e319f5f9f3d7e2 Command failed on smithi045 with status 22: 'sudo cephadm --image quay- quay-quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 20711e2c-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi162' [7333791] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:10:08 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333791/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333791/ sentry: https://sentry.ceph.com/organizations/ceph/?query=67fde2c2b4344880acaef4807a5c21b0 Command failed on smithi082 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a0f61734-1ff4-11ee-9b31-001a4aab830c -- ceph orch host add smithi144' [7333794] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:11:06 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333794/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333794/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f63f9651a3c24eeda09637812b1bac28 Command failed on smithi053 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 298e1f60-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi114' [7333795] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:09:50 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333795/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333795/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe23c6cd492249bc87f61a621cbe5567 Command failed on smithi066 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d8d670b2-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi139' [7333796] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} ----------------------------------------------------------------- time: 00:18:33 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333796/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333796/ sentry: https://sentry.ceph.com/organizations/ceph/?query=28bc33b5faed48b3966d4246f340de32 Test failure: test_error (tasks.mgr.test_orchestrator_cli.TestOrchestratorCli) [7333798] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:09:54 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333798/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333798/ sentry: https://sentry.ceph.com/organizations/ceph/?query=671328318a5e462c8d0a53f5b7c81c40 Command failed on smithi046 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5e17f756-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi073' [7333799] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:21:22 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333799/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333799/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d364d7f5bee3446495e399cd37a6d77a Command failed on smithi033 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6b122750-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi184' [7333801] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:10:11 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333801/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333801/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6053d4a6e0b64665a0910341aa961965 Command failed on smithi093 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2f1d9366-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi102' [7333802] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:09:15 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333802/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333802/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b13cee960a5a4dbd88684c0f411785e0 Command failed on smithi090 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9fb37a64-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi177' [7333803] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:09:25 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333803/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333803/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ad8e8e8305f4199b6ae1fc1b5e201de Command failed on smithi116 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9262da80-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi152' [7333805] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:19:37 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333805/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333805/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f99a24fb4a8048b191d984a2cc317cc3 Command failed on smithi069 with status 22: 'sudo cephadm --image quay- quay-quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4e68132a-1ff7-11ee-9b31-001a4aab830c -- ceph orch host add smithi145' [7333806] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:13:22 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333806/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333806/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b8ffb181f6743aa8e8b86796eca54fb Command failed on smithi101 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fa80aeee-1ff5-11ee-9b31-001a4aab830c -- ceph orch host add smithi155' [7333809] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} ----------------------------------------------------------------- time: 00:15:05 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333809/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333809/ sentry: https://sentry.ceph.com/organizations/ceph/?query=753395c9596c4b519d39b84a6de9a97c Command failed on smithi112 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 59a564aa-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi175' [7333810] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:11:03 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333810/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333810/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ecddf4748594988a6060f9fe5b53f71 Command failed on smithi083 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 47622a4e-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi119' [7333811] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:12:43 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333811/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333811/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d73a53f876ab4263bcca877ca652ea7b Command failed on smithi107 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c00c8200-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi157' [7333813] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:09:41 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333813/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333813/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3870e55666d14c0693f1d5e0e4a9e05a Command failed on smithi042 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2e3f2cce-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi104' [7333814] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:13:57 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333814/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333814/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e5b3e092343c4a70b4143d60f648f146 Command failed on smithi062 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6446b206-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi125' [7333815] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:09:53 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333815/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333815/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e11d52e072b54c6e8751166211527e57 Command failed on smithi038 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 61f59760-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi070' [7333816] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_monitoring_stack_basic} ----------------------------------------------------------------- time: 00:20:31 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333816/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333816/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b5727635aaa49d489442f0a88b9d764 Command failed on smithi022 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c2cb20e0-1ff7-11ee-9b31-001a4aab830c -- ceph orch host add smithi137' [7333817] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:22:58 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333817/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333817/ sentry: https://sentry.ceph.com/organizations/ceph/?query=35f1dae4b309410ea0e6e3c4cf351ce5 Command failed on smithi067 with status 22: 'sudo cephadm --image quay- quay-quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2283e2f6-1ff8-11ee-9b31-001a4aab830c -- ceph orch host add smithi117' [7333818] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:09:14 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333818/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333818/ sentry: https://sentry.ceph.com/organizations/ceph/?query=42b4ba892a464d2e961663f080e18daf Command failed on smithi100 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ee36924c-1ff6-11ee-9b31-001a4aab830c -- ceph orch host add smithi136' [7333820] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:09:50 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333820/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333820/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cddc644732f34c02a754df638ca6ce1f Command failed on smithi031 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5262ad82-1ff7-11ee-9b31-001a4aab830c -- ceph orch host add smithi194' [7333821] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:14:58 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333821/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333821/ sentry: https://sentry.ceph.com/organizations/ceph/?query=70ccef6b55874794ab9cc3e549bbe7d9 Command failed on smithi088 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3b58dac0-1ff8-11ee-9b31-001a4aab830c -- ceph orch host add smithi134' [7333824] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:09:46 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333824/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333824/ sentry: https://sentry.ceph.com/organizations/ceph/?query=51b84fbf9f4d4bfdb5da3cc545178141 Command failed on smithi032 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6fbf6816-1ff7-11ee-9b31-001a4aab830c -- ceph orch host add smithi151' [7333825] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:20:56 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333825/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333825/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01f520ce8d5249e88236aeca97f1beb9 Command failed on smithi003 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b1765b10-1ff8-11ee-9b31-001a4aab830c -- ceph orch host add smithi092' [7333826] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:09:43 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333826/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333826/ sentry: https://sentry.ceph.com/organizations/ceph/?query=36923cc124f94b308d70b8801a027f18 Command failed on smithi082 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 85b233f6-1ff7-11ee-9b31-001a4aab830c -- ceph orch host add smithi144' [7333827] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:12:29 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333827/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333827/ sentry: https://sentry.ceph.com/organizations/ceph/?query=47bf7c99ee894a6a8ebb856a622dd3f6 Command failed on smithi061 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7dc8c9e8-1ff7-11ee-9b31-001a4aab830c -- ceph orch host add smithi190' [7333828] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:12:44 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333828/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333828/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f701cdcedb9541fb8751db944b1326ac Command failed on smithi044 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b22b7884-1ff7-11ee-9b31-001a4aab830c -- ceph orch host add smithi196' [7333830] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} ----------------------------------------------------------------- time: 00:12:35 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333830/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333830/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5de75dbc26984789a6a00098cbf8d5dd Command failed on smithi084 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e2e9656c-1ff7-11ee-9b31-001a4aab830c -- ceph orch host add smithi160' [7333831] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:16:56 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333831/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333831/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a302406a173d4f2fa0cb895eb699a154 Command failed on smithi153 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4109db62-1ff9-11ee-9b31-001a4aab830c -- ceph orch host add smithi163' [7333832] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:10:41 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333832/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333832/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fb98196e3c3d48c69fb062848650de3d Command failed on smithi118 with status 22: 'sudo cephadm --image quay- quay-quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4ef4bed2-1ff8-11ee-9b31-001a4aab830c -- ceph orch host add smithi149' [7333833] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:14:13 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333833/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333833/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6ce586f2e2b341de8ce051c3bf41a411 Command failed on smithi053 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a41845a4-1ff9-11ee-9b31-001a4aab830c -- ceph orch host add smithi093' [7333835] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:09:41 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333835/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333835/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a930157c4b1549e18f3fbe21ddf04472 Command failed on smithi090 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4a8ed0a8-1ff8-11ee-9b31-001a4aab830c -- ceph orch host add smithi177' [7333836] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:19:52 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333836/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333836/ sentry: https://sentry.ceph.com/organizations/ceph/?query=74c5185e2149408b9a153f59839cc87c Command failed on smithi046 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:380d5f563a9b33646d87bc13236bdb05a2c4c461 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6b395a6-1ff9-11ee-9b31-001a4aab830c -- ceph orch host add smithi073' Pass ================================================================= [7333749] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:39:30 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333749/ [7333752] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:12:44 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333752/ [7333757] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_nfs} time: 00:38:50 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333757/ [7333760] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:36:52 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333760/ [7333764] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} time: 00:21:50 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333764/ [7333765] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:19 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333765/ [7333779] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:35:19 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333779/ [7333780] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:45:58 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333780/ [7333783] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:40:05 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333783/ [7333790] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_adoption} time: 00:25:47 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333790/ [7333792] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:03 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333792/ [7333793] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} time: 00:19:40 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333793/ [7333797] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:19:56 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333797/ [7333800] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:35:51 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333800/ [7333804] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} time: 00:09:22 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333804/ [7333807] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:48 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333807/ [7333808] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:15:57 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333808/ [7333812] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:39:44 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333812/ [7333819] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:12 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333819/ [7333822] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:28:17 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333822/ [7333823] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_nfs} time: 00:37:05 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333823/ [7333829] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli} time: 00:19:12 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333829/ [7333834] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:45 info: http://pulpito.ceph.com/adking-2023-07-11_13:15:31-orch:cephadm-wip-adk-testing-2023-07-10-1413-distro-default-smithi/7333834/