2022-07-28T07:15:22.479 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1 2022-07-28T07:15:22.480 INFO:teuthology.results:subset: '1/999' 2022-07-28T07:15:22.481 INFO:teuthology.results:seed: '7723' 2022-07-28T08:25:03.369 INFO:root:teuthology version: 1.1.1.dev399+g5f965ce1 2022-07-28T08:25:03.389 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-07-28T20:25:04.903 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2022-07-28T20:25:09.764 INFO:scrape:Found 63 jobs 2022-07-28T20:25:15.991 INFO:scrape:Found 7 distinct failure reasons 2022-07-28T20:25:15.992 INFO:scrape:Failure: reached maximum tries (120) after waiting for 120 seconds 2022-07-28T20:25:15.993 INFO:scrape:17 jobs: ['6951625', '6951664', '6951674', '6951647', '6951654', '6951682', '6951635', '6951640', '6951655', '6951669', '6951677', '6951637', '6951634', '6951653', '6951645', '6951623', '6951665'] 2022-07-28T20:25:16.000 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start'] 2022-07-28T20:25:16.001 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-services/client-keyring', '2-services/iscsi', '2-services/mirror', '2-services/nfs', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs2', '2-services/rgw', '2-services/rgw-ingress', '3-final}', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8'] 2022-07-28T20:25:16.002 INFO:scrape: 2022-07-28T20:25:16.002 INFO:scrape:Dead: b'2022-07-28T19:38:55.886 DEBUG:teuthology.exit:Finished running handlers' 2022-07-28T20:25:16.003 INFO:scrape:31 jobs 2022-07-28T20:25:16.004 INFO:scrape:suites intersection: [] 2022-07-28T20:25:16.005 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/octopus', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-nfs', '2-repo_digest/defaut', '2-services/basic', '2-services/iscsi', '2-services/nfs-ingress2', '2-services/rgw', '2-thrash', '3-final}', '3-inline/no', '3-inline/yes', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', '3-upgrade-with-workload', '3-upgrade/simple', '4-final}', '4-verify}', '4-verify}}', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'base/install', 'centos_8.stream_container_tools', 'cluster/{fixed-3', 'conf/{client', 'fixed-2', 'mds', 'mode/packaged', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'openstack}', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch:cephadm/rbd_iscsi/{0-single-container-host', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0}', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04}', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/smoke/{0-distro/ubuntu_20.04', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/thrash/{0-distro/ubuntu_20.04', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'orch:cephadm/workunits/{agent/off', 'orch:cephadm/workunits/{agent/on', 'osd}', 'overrides/{pg-warn', 'roles', 'root}', 'start', 'start}', 'syntax', 'task/test_nfs}', 'task/test_orch_cli}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/cephadm_iscsi}'] 2022-07-28T20:25:16.006 INFO:scrape: 2022-07-28T20:25:16.007 INFO:scrape:Dead: b'2022-07-28T20:20:00.425 INFO:journalctl@ceph.mon.b.smithi129.stdout:Jul 28 20:20:00 smithi129 ceph-mon[100844]: overall HEALTH_WARN no active mgr' 2022-07-28T20:25:16.007 INFO:scrape:3 jobs: ['6951681', '6951678', '6951680'] 2022-07-28T20:25:16.008 INFO:scrape:suites intersection: ['fixed-2'] 2022-07-28T20:25:16.009 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-thrash', '3-tasks/snaps-few-objects', 'agent/on', 'fixed-2', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'root}', 'start', 'start}', 'tasks/rados_python}'] 2022-07-28T20:25:16.009 INFO:scrape: 2022-07-28T20:25:16.010 INFO:scrape:Failure: Command failed on smithi131 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a056801c-0e4c-11ed-8430-001a4aab830c -e sha1=9957c1b4626ce3b284efa118685380f5de5f5b9c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' 2022-07-28T20:25:16.011 INFO:scrape:4 jobs: ['6951650', '6951643', '6951628', '6951675'] 2022-07-28T20:25:16.012 INFO:scrape:suites intersection: [] 2022-07-28T20:25:16.013 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-start', '2-nfs', '2-repo_digest/repo_digest', '3-upgrade-with-workload', '3-upgrade/staggered', '4-final}', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'mon_election/connectivity}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9'] 2022-07-28T20:25:16.014 INFO:scrape: 2022-07-28T20:25:16.015 INFO:scrape:Dead: b'2022-07-28T20:25:11.268 INFO:teuthology.orchestra.run.smithi099.stderr:dumped fsmap epoch 15' 2022-07-28T20:25:16.016 INFO:scrape:1 jobs: ['6951683'] 2022-07-28T20:25:16.016 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{pg-warn', 'roles', 'syntax', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-07-28T20:25:16.017 INFO:scrape: 2022-07-28T20:25:16.018 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json 2022-07-28T20:25:16.019 INFO:scrape:1 jobs: ['6951629'] 2022-07-28T20:25:16.020 INFO:scrape:suites: ['2-node-mgr', 'agent/off', 'orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8}', 'orchestrator_cli}'] 2022-07-28T20:25:16.021 INFO:scrape: 2022-07-28T20:25:16.022 INFO:scrape:Dead: b'2022-07-28T20:20:00.414 INFO:journalctl@ceph.mon.smithi037.smithi037.stdout:Jul 28 20:20:00 smithi037 bash[18387]: cluster 2022-07-28T20:20:00.000167+0000 mon.smithi037 (mon.0) 2570 : cluster [WRN] overall HEALTH_WARN no active mgr' 2022-07-28T20:25:16.023 INFO:scrape:1 jobs: ['6951676'] 2022-07-28T20:25:16.024 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'orch:cephadm/osds/{0-distro/ubuntu_20.04'] 2022-07-28T20:25:16.025 INFO:scrape: 2022-07-28T20:25:16.028 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/ failed: 22 dead: 29 running: 7 waiting: 0 queued: 0 passed: 5 Fail ================================================================= [6951623] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:17:47 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951623/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951623/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df40cc9a611f406a8e920878f8477a7f reached maximum tries (120) after waiting for 120 seconds [6951625] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:17:06 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951625/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951625/ sentry: https://sentry.ceph.com/organizations/ceph/?query=079f85add10148e0b11bf3ffd4fda9aa reached maximum tries (120) after waiting for 120 seconds [6951628] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:23:46 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951628/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951628/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0b77a04453745fe8a7d8e34a00ee2a5 Command failed on smithi169 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 683e9fba-0e48-11ed-8430-001a4aab830c -e sha1=9957c1b4626ce3b284efa118685380f5de5f5b9c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [6951629] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} ----------------------------------------------------------------- time: 00:13:17 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951629/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951629/ sentry: https://sentry.ceph.com/organizations/ceph/?query=abe29c8323bb471a93ebc50305912557 Command failed on smithi036 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [6951634] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:18:04 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951634/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951634/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c12f1d544e744d879f9c87e7bb746aa1 reached maximum tries (120) after waiting for 120 seconds [6951635] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:17:52 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951635/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951635/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eb9bf711bddf4e79a2f060600043effb reached maximum tries (120) after waiting for 120 seconds [6951637] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:20:19 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951637/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951637/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ac9cb851d3b4b8f8a52757ebbb2d887 reached maximum tries (120) after waiting for 120 seconds [6951640] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:18:53 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951640/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951640/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a045b55f0f8b4036951b6ab708ba41bd reached maximum tries (120) after waiting for 120 seconds [6951643] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:24:53 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951643/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951643/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f2e8f9f35c0c49b7af5d107fdbd5c531 Command failed on smithi036 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2777e6aa-0e4b-11ed-8430-001a4aab830c -e sha1=9957c1b4626ce3b284efa118685380f5de5f5b9c -- bash -c \'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1\'' [6951645] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:27:50 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951645/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951645/ sentry: https://sentry.ceph.com/organizations/ceph/?query=64d7e2c188e141dfb00f5fd870b661a6 reached maximum tries (120) after waiting for 120 seconds [6951647] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:17:31 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951647/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951647/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6adf9f8844d24dafa217688029db522b reached maximum tries (120) after waiting for 120 seconds [6951650] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:20:05 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951650/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951650/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca0058e0465048ef8d793eaeaf7a7805 Command failed on smithi131 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a056801c-0e4c-11ed-8430-001a4aab830c -e sha1=9957c1b4626ce3b284efa118685380f5de5f5b9c -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | keys\'"\'"\' | grep $sha1\'' [6951653] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:17:34 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951653/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951653/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4922e3cb1e0b4c69ab378ba3429296c9 reached maximum tries (120) after waiting for 120 seconds [6951654] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:19:50 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951654/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951654/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1f69a2b5073e46808657dc641160848f reached maximum tries (120) after waiting for 120 seconds [6951655] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:20:22 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951655/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951655/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dbb57762ddb94f1cb21cbbc2d053f1a5 reached maximum tries (120) after waiting for 120 seconds [6951664] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:22:37 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951664/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951664/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a7ee2ad6a2d442ba8cba96ee980337b1 reached maximum tries (120) after waiting for 120 seconds [6951665] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:19:15 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951665/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951665/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b13f9792171c491c9b8998116833d1df reached maximum tries (120) after waiting for 120 seconds [6951669] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:17:26 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951669/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951669/ sentry: https://sentry.ceph.com/organizations/ceph/?query=16c0bc7af0274720bdd529494f5fa1b9 reached maximum tries (120) after waiting for 120 seconds [6951674] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:17:05 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951674/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951674/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7df39ab61cca416e81d32de242e92ce8 reached maximum tries (120) after waiting for 120 seconds [6951675] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:24:37 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951675/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951675/ sentry: https://sentry.ceph.com/organizations/ceph/?query=994f720974f742a8b44ac366e4e6de52 Command failed on smithi036 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.9 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d5645a-0e4f-11ed-8430-001a4aab830c -e sha1=9957c1b4626ce3b284efa118685380f5de5f5b9c -- bash -c \'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1\'' [6951677] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:20:05 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951677/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951677/ sentry: https://sentry.ceph.com/organizations/ceph/?query=17c368f8cf5944aa8550dd57ef4eaba2 reached maximum tries (120) after waiting for 120 seconds [6951682] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:17:59 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951682/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951682/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c4f6dcbd190a4b059ffb988a8314fad5 reached maximum tries (120) after waiting for 120 seconds Dead ================================================================= [6951621] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951621/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951621/ hit max job timeout [6951622] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951622/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951622/ hit max job timeout [6951624] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951624/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951624/ hit max job timeout [6951626] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951626/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951626/ hit max job timeout [6951627] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951627/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951627/ hit max job timeout [6951630] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951630/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951630/ hit max job timeout [6951631] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951631/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951631/ hit max job timeout [6951632] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951632/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951632/ hit max job timeout [6951636] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951636/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951636/ hit max job timeout [6951638] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951638/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951638/ hit max job timeout [6951639] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951639/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951639/ hit max job timeout [6951641] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951641/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951641/ hit max job timeout [6951642] orch:cephadm/workunits/{agent/off mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951642/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951642/ hit max job timeout [6951644] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951644/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951644/ hit max job timeout [6951646] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951646/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951646/ hit max job timeout [6951648] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951648/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951648/ hit max job timeout [6951649] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951649/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951649/ hit max job timeout [6951651] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951651/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951651/ hit max job timeout [6951652] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951652/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951652/ hit max job timeout [6951656] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951656/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951656/ hit max job timeout [6951657] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951657/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951657/ hit max job timeout [6951658] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951658/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951658/ hit max job timeout [6951659] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951659/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951659/ hit max job timeout [6951661] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951661/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951661/ hit max job timeout [6951662] orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951662/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951662/ hit max job timeout [6951666] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951666/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951666/ hit max job timeout [6951667] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951667/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951667/ hit max job timeout [6951670] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951670/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951670/ hit max job timeout [6951671] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951671/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951671/ hit max job timeout Running ================================================================= [6951672] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951672/ [6951673] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951673/ [6951676] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951676/ [6951678] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951678/ [6951680] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951680/ [6951681] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951681/ [6951683] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951683/ Pass ================================================================= [6951633] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:05:41 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951633/ [6951660] orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} time: 00:12:48 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951660/ [6951663] orch:cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:09:29 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951663/ [6951668] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} time: 00:17:59 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951668/ [6951679] orch:cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:05:36 info: http://pulpito.ceph.com/gabrioux-2022-07-28_05:39:24-orch:cephadm-wip-adk3-testing-2022-07-27-2041-quincy-distro-default-smithi/6951679/