2023-07-13T23:15:34.373 INFO:root:teuthology version: 0.0.1.dev143+g073e6eb 2023-07-13T23:15:34.374 INFO:teuthology.results:subset: '1/8' 2023-07-13T23:15:34.374 INFO:teuthology.results:seed: '1644' 2023-07-14T00:16:13.340 INFO:root:teuthology version: 0.0.1.dev145+gaa6a80e 2023-07-14T00:16:13.376 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-14T01:27:19.429 INFO:teuthology.results:Tests finished! gathering results... 2023-07-14T01:27:27.578 INFO:scrape:Found 109 jobs 2023-07-14T01:27:27.579 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336709/teuthology.log 2023-07-14T01:27:29.128 INFO:scrape:Found 9 distinct failure reasons 2023-07-14T01:27:29.129 INFO:scrape:Dead: None 2023-07-14T01:27:29.130 INFO:scrape:16 jobs: ['7336709', '7336653', '7336676', '7336737', '7336724', '7336644', '7336624', '7336678', '7336657', '7336646', '7336711', '7336659', '7336640', '7336655', '7336642', '7336648'] 2023-07-14T01:27:29.130 INFO:scrape: 2023-07-14T01:27:29.130 INFO:scrape:Failure: Command failed on smithi082 with status 60: 'curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a268cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' 2023-07-14T01:27:29.131 INFO:scrape:6 jobs: ['7336591', '7336755', '7336616', '7336770', '7336728', '7336790'] 2023-07-14T01:27:29.131 INFO:scrape:suites intersection: ['0-nvme-loop'] 2023-07-14T01:27:29.131 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', '2-services/client-keyring', '2-services/nfs-haproxy-proto', '2-services/nfs-ingress-rgw-bucket', '3-final}', 'agent/on', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/osds/{0-distro/ubuntu_20.04', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'orch:cephadm/smoke/{0-distro/ubuntu_20.04', 'start}'] 2023-07-14T01:27:29.132 INFO:scrape: 2023-07-14T01:27:29.132 INFO:scrape:Failure: 'tuple' object has no attribute 'get' 2023-07-14T01:27:29.132 INFO:scrape:2 jobs: ['7336663', '7336685'] 2023-07-14T01:27:29.133 INFO:scrape:suites intersection: [] 2023-07-14T01:27:29.133 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/rgw-ingress', '3-final}', 'agent/on', 'mon_election/connectivity', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_nfs}'] 2023-07-14T01:27:29.133 INFO:scrape: 2023-07-14T01:27:29.134 INFO:scrape:Failure: HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a268cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) 2023-07-14T01:27:29.135 INFO:scrape:13 jobs: ['7336595', '7336748', '7336698', '7336792', '7336687', '7336774', '7336597', '7336631', '7336744', '7336563', '7336700', '7336618', '7336794'] 2023-07-14T01:27:29.135 INFO:scrape:suites intersection: [] 2023-07-14T01:27:29.136 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-thrash', '3-inline/no', '3-tasks/radosbench', '3-tasks/small-objects', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'agent/off', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'fixed-2', 'ignorelist_wrongly_marked_down', 'mds', 'mode/packaged', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/thrash/{0-distro/ubuntu_20.04', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'orch:cephadm/workunits/{0-distro/ubuntu_20.04', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'root}', 'start', 'syntax}', 'task/test_orch_cli_mon}', 'task/test_rgw_multisite}', 'task/test_set_mon_crush_locations}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'tasks/rotate-keys}', 'tasks/{0-from/v16.2.4'] 2023-07-14T01:27:29.137 INFO:scrape: 2023-07-14T01:27:29.138 INFO:scrape:Failure: Stale jobs detected, aborting. 2023-07-14T01:27:29.138 INFO:scrape:1 jobs: ['7336650'] 2023-07-14T01:27:29.139 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-keepalive-only', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04'] 2023-07-14T01:27:29.140 INFO:scrape: 2023-07-14T01:27:29.140 INFO:scrape:Failure: Command failed on smithi053 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:22c8e0a268cd1eb512239624dfbdd2e91e58a626 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae97fbd6-21da-11ee-9b32-001a4aab830c -- ceph orch ls -f json' 2023-07-14T01:27:29.141 INFO:scrape:1 jobs: ['7336702'] 2023-07-14T01:27:29.141 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/rgw', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8'] 2023-07-14T01:27:29.141 INFO:scrape: 2023-07-14T01:27:29.142 INFO:scrape:Dead: b"TypeError: argument of type 'NoneType' is not iterable" 2023-07-14T01:27:29.143 INFO:scrape:1 jobs: ['7336731'] 2023-07-14T01:27:29.143 INFO:scrape:suites: ['1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2023-07-14T01:27:29.144 INFO:scrape: 2023-07-14T01:27:29.144 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds 2023-07-14T01:27:29.144 INFO:scrape:2 jobs: ['7336555', '7336757'] 2023-07-14T01:27:29.145 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}'] 2023-07-14T01:27:29.145 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0'] 2023-07-14T01:27:29.145 INFO:scrape: 2023-07-14T01:27:29.146 INFO:scrape:Failure: Command failed on smithi097 with status 1: 'sudo yum install -y kernel' 2023-07-14T01:27:29.146 INFO:scrape:1 jobs: ['7336722'] 2023-07-14T01:27:29.146 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/yes', '2-client', '3-inline/yes', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/yes', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific'] 2023-07-14T01:27:29.147 INFO:scrape: 2023-07-14T01:27:29.150 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/ failed: 24 dead: 19 running: 0 waiting: 0 queued: 0 passed: 66 Fail ================================================================= [7336555] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:39:06 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336555/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336555/ sentry: https://sentry.ceph.com/organizations/ceph/?query=53bff964e9cd4e898ece74d37c2c27b3 reached maximum tries (301) after waiting for 300 seconds [7336563] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:09:21 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336563/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336563/ sentry: https://sentry.ceph.com/organizations/ceph/?query=56e3cdad391f4073a73ac8aeb9f30f80 HTTPSConnectionPool(host='chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/cent os/8/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336591] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} ----------------------------------------------------------------- time: 00:07:13 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336591/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336591/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76d8ed78ba014e648839855a630dd187 Command failed on smithi082 with status 60: 'curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-4-2023-07-13-1258 /22c8e0a268cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/x86_64/flavors/defau lt/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7336595] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:57 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336595/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336595/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1a0f96358180487db736b59883eaf0fc HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a2 68cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336597] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:07:26 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336597/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336597/ sentry: https://sentry.ceph.com/organizations/ceph/?query=271f6c8a000c4780ad95ea30b6ddb6b0 HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a2 68cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336616] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:06:41 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336616/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336616/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bb86e47f335e481c862e37d5643cf54d Command failed on smithi038 with status 60: 'curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-4-2023-07-13-1258 /22c8e0a268cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/x86_64/flavors/defau lt/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7336618] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:07:05 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336618/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336618/ sentry: https://sentry.ceph.com/organizations/ceph/?query=86aeb2a9783e49dfa1425855cee34fec HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a2 68cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336631] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:09:15 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336631/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336631/ sentry: https://sentry.ceph.com/organizations/ceph/?query=780fd51d06794372994408e5aa4898ca HTTPSConnectionPool(host='chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/cent os/8/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336650] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336650/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336650/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b1f44455964470ca65031586f37ce10 Stale jobs detected, aborting. [7336687] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:08:50 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336687/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336687/ sentry: https://sentry.ceph.com/organizations/ceph/?query=368b2b6e258c4f8caa33312baad8fc7e HTTPSConnectionPool(host='chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/cent os/8/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336698] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:51 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336698/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336698/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fcbc35f701464ac38d860501416b659f HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a2 68cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336700] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} ----------------------------------------------------------------- time: 00:07:16 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336700/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336700/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d3fc926d36144faa9aa8e839a5524d1c HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a2 68cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336702] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:20:17 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336702/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336702/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8a6826c0f1be4ea0b9b847f4c44b88d7 Command failed on smithi053 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:22c8e0a268cd1eb512239624dfbdd2e91e58a626 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae97fbd6-21da-11ee-9b32-001a4aab830c -- ceph orch ls -f json' [7336722] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336722/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336722/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79278030cf8746c9b1e4f249ed5634ec Command failed on smithi097 with status 1: 'sudo yum install -y kernel' [7336728] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:06:57 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336728/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336728/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f573f788b4c144d998abe14ddf481631 Command failed on smithi133 with status 60: 'curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-4-2023-07-13-1258 /22c8e0a268cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/x86_64/flavors/defau lt/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7336744] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:10 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336744/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336744/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b510af4ee79e4deb922d7931ea3c8736 HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a2 68cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336748] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:08:02 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336748/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336748/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6deef14229fe47089141f48905a03e5f HTTPSConnectionPool(host='chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/pacific/3cbe25cde3cfa028984618ad32de9edc4c1eaed0/cent os/8/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336755] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:06:34 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336755/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336755/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e9972a3a14fd42ccae520a48589248c4 Command failed on smithi097 with status 60: 'curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-4-2023-07-13-1258 /22c8e0a268cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/x86_64/flavors/defau lt/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7336757] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:30:33 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336757/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336757/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b2a30dffc0cd402c8c09dc124e373fda reached maximum tries (301) after waiting for 300 seconds [7336770] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:46 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336770/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336770/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3cf934065b7b406a8805a325f01b1158 Command failed on smithi070 with status 60: 'curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-4-2023-07-13-1258 /22c8e0a268cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/x86_64/flavors/defau lt/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7336774] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:06:39 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336774/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336774/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b507d12b37c0469e91973b7b7a2b2591 HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a2 68cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336790] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:06:23 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336790/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336790/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8dff4603d8ea4b0d8ddb6ea44cb2db66 Command failed on smithi159 with status 60: 'curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-guits-testing-4-2023-07-13-1258 /22c8e0a268cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/x86_64/flavors/defau lt/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm' [7336792] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:06:42 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336792/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336792/ sentry: https://sentry.ceph.com/organizations/ceph/?query=68da3da018c049518672fa4423e721bc HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a2 68cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) [7336794] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_set_mon_crush_locations} ----------------------------------------------------------------- time: 00:07:11 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336794/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336794/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c33f9754ad61477b82d84639a405ec0a HTTPSConnectionPool(host='1.chacra.ceph.com', port=443): Max retries exceeded with url: /repos/ceph/wip-guits-testing-4-2023-07-13-1258/22c8e0a2 68cd1eb512239624dfbdd2e91e58a626/ubuntu/focal/flavors/default/repo (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1108)'))) Dead ================================================================= [7336624] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336624/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336624/ Error reimaging machines: Failed to power on smithi101 [7336640] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336640/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336640/ Error reimaging machines: Failed to power on smithi029 [7336642] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336642/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336642/ Error reimaging machines: Failed to power on smithi152 [7336644] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336644/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336644/ Error reimaging machines: Cannot connect to remote host smithi133 [7336646] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336646/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336646/ Error reimaging machines: Cannot connect to remote host smithi046 [7336648] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336648/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336648/ Error reimaging machines: Expected smithi026's OS to be centos 8 but found rhel 8.6 [7336653] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336653/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336653/ Error reimaging machines: Expected smithi192's OS to be centos 8 but found rhel 8.6 [7336655] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336655/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336655/ Error reimaging machines: Expected smithi154's OS to be centos 8 but found ubuntu 20.04 [7336657] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336657/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336657/ Error reimaging machines: Expected smithi088's OS to be centos 8 but found ubuntu 20.04 [7336659] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336659/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336659/ Error reimaging machines: Expected smithi170's OS to be centos 8 but found rhel 8.6 [7336663] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:03:55 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336663/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336663/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2bc67625910b48198cbe56823ba7f8be 'tuple' object has no attribute 'get' [7336676] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336676/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336676/ Error reimaging machines: Cannot connect to remote host smithi202 [7336678] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336678/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336678/ Error reimaging machines: Cannot connect to remote host smithi202 [7336685] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:10:57 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336685/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336685/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ec0c9d2821d498aa0d8dde9577228e9 'tuple' object has no attribute 'get' [7336709] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336709/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336709/ Error reimaging machines: Failed to power on smithi083 [7336711] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336711/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336711/ Error reimaging machines: Failed to power on smithi171 [7336724] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336724/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336724/ Error reimaging machines: 500 Server Error: Internal Server Error for url: http://fog.front.sepia.ceph.com/fog/host/202/task [7336731] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336731/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336731/ [7336737] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336737/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336737/ Error reimaging machines: Failed to power on smithi055 Pass ================================================================= [7336557] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:35:51 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336557/ [7336559] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_nfs} time: 00:36:14 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336559/ [7336568] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:40:44 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336568/ [7336571] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} time: 00:24:10 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336571/ [7336573] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:42:40 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336573/ [7336575] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:14:12 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336575/ [7336577] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:24 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336577/ [7336580] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:46:49 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336580/ [7336582] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:20:23 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336582/ [7336584] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:35:26 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336584/ [7336586] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli} time: 00:24:34 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336586/ [7336589] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:20:51 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336589/ [7336593] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:45:57 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336593/ [7336599] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:29:24 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336599/ [7336601] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:23:14 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336601/ [7336604] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:42 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336604/ [7336606] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:12 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336606/ [7336608] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:33:51 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336608/ [7336610] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:28:18 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336610/ [7336612] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:21:08 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336612/ [7336615] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:07 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336615/ [7336620] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:46:39 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336620/ [7336622] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} time: 00:18:11 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336622/ [7336626] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:30:12 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336626/ [7336629] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} time: 00:27:26 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336629/ [7336633] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:38 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336633/ [7336635] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:35:57 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336635/ [7336637] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:19:36 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336637/ [7336661] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:30:42 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336661/ [7336665] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:34 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336665/ [7336668] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} time: 00:33:10 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336668/ [7336670] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:22:25 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336670/ [7336672] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:33 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336672/ [7336674] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:14 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336674/ [7336680] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:43:20 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336680/ [7336683] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:38:48 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336683/ [7336689] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli} time: 00:21:07 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336689/ [7336691] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:15:43 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336691/ [7336693] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:00 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336693/ [7336696] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:47:47 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336696/ [7336704] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} time: 00:31:42 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336704/ [7336707] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:28:29 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336707/ [7336713] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:25:46 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336713/ [7336715] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:46:05 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336715/ [7336717] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:40:43 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336717/ [7336720] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} time: 00:18:12 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336720/ [7336726] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} time: 00:26:11 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336726/ [7336733] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} time: 00:32:02 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336733/ [7336735] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} time: 00:13:45 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336735/ [7336739] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:32 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336739/ [7336742] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:52:19 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336742/ [7336746] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:22:41 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336746/ [7336750] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:11 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336750/ [7336753] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:36:16 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336753/ [7336759] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:27:28 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336759/ [7336761] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} time: 00:31:27 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336761/ [7336763] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:20:34 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336763/ [7336766] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} time: 00:34:39 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336766/ [7336768] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} time: 00:18:54 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336768/ [7336772] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:19:41 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336772/ [7336777] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:51:03 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336777/ [7336779] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:40:48 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336779/ [7336781] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:34:25 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336781/ [7336783] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:32:52 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336783/ [7336785] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:30:19 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336785/ [7336788] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:03 info: http://pulpito.ceph.com/gabrioux-2023-07-13_23:14:03-orch:cephadm-wip-guits-testing-4-2023-07-13-1258-distro-default-smithi/7336788/