2023-07-21T07:21:54.238 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T07:21:54.240 INFO:teuthology.results:subset: '1/8' 2023-07-21T07:21:54.240 INFO:teuthology.results:seed: '4516' 2023-07-21T08:52:40.956 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T08:52:41.030 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-07-21T10:10:56.801 INFO:teuthology.results:Tests finished! gathering results... 2023-07-21T10:11:02.591 INFO:scrape:Found 107 jobs 2023-07-21T10:11:02.592 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346470/teuthology.log 2023-07-21T10:11:04.466 INFO:scrape:Found 4 distinct failure reasons 2023-07-21T10:11:04.467 INFO:scrape:Dead: None 2023-07-21T10:11:04.467 INFO:scrape:28 jobs: ['7346470', '7346469', '7346487', '7346520', '7346544', '7346489', '7346446', '7346483', '7346467', '7346465', '7346471', '7346538', '7346522', '7346463', '7346535', '7346545', '7346468', '7346462', '7346466', '7346519', '7346518', '7346521', '7346484', '7346485', '7346534', '7346536', '7346461', '7346517'] 2023-07-21T10:11:04.467 INFO:scrape: 2023-07-21T10:11:04.468 INFO:scrape:Failure: Command failed on smithi097 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f836f8c6-27a4-11ee-9b34-001a4aab830c -- bash -c 'ceph orch upgrade ls'" 2023-07-21T10:11:04.468 INFO:scrape:4 jobs: ['7346528', '7346474', '7346502', '7346449'] 2023-07-21T10:11:04.468 INFO:scrape:suites intersection: ['4-wait', '5-upgrade-ls'] 2023-07-21T10:11:04.469 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-upgrade/simple', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'mon_election/classic}', 'mon_election/connectivity}', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04'] 2023-07-21T10:11:04.469 INFO:scrape: 2023-07-21T10:11:04.469 INFO:scrape:Failure: {'/dev/vg_nvme: already exists in filesystem', "Run `vgcreate --help' for more information.", "Creating volume group 'vg_nvme' failed"} 2023-07-21T10:11:04.469 INFO:scrape:2 jobs: ['7346537', '7346486'] 2023-07-21T10:11:04.470 INFO:scrape:suites intersection: [] 2023-07-21T10:11:04.470 INFO:scrape:suites union: ['1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '2-thrash', '3-inline/yes', '3-tasks/small-objects', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/yes', 'fixed-2', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'msgr/async', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/thrash/{0-distro/ubuntu_20.04', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'root}', 'syntax}', 'tasks/{0-from/pacific'] 2023-07-21T10:11:04.470 INFO:scrape: 2023-07-21T10:11:04.471 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds 2023-07-21T10:11:04.471 INFO:scrape:2 jobs: ['7346440', '7346530'] 2023-07-21T10:11:04.471 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}'] 2023-07-21T10:11:04.471 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0'] 2023-07-21T10:11:04.472 INFO:scrape: 2023-07-21T10:11:04.475 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/ failed: 6 dead: 30 running: 0 waiting: 0 queued: 0 passed: 71 Fail ================================================================= [7346440] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:40:28 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346440/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346440/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7bb981e5cf94431eb4c8bdf113c1c69d reached maximum tries (301) after waiting for 300 seconds [7346449] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:46:50 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346449/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346449/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0bd1c17b1c24389b5a2ae48933de48e Command failed on smithi100 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5e6a794c-279b-11ee-9b34-001a4aab830c -- bash -c 'ceph orch upgrade ls'" [7346474] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:36:54 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346474/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346474/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aaa3878a31674baa8f7750bb8627fc50 Command failed on smithi103 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid afdd2d5c-279f-11ee-9b34-001a4aab830c -- bash -c 'ceph orch upgrade ls'" [7346502] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:45:53 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346502/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346502/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b8723a3bbd24adaa17f0ec9d3282d42 Command failed on smithi032 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8db2a014-27a3-11ee-9b34-001a4aab830c -- bash -c 'ceph orch upgrade ls'" [7346528] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} ----------------------------------------------------------------- time: 00:36:35 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346528/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346528/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b107323fb6464690b0fb433123057a99 Command failed on smithi097 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f836f8c6-27a4-11ee-9b34-001a4aab830c -- bash -c 'ceph orch upgrade ls'" [7346530] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:30:11 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346530/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346530/ sentry: https://sentry.ceph.com/organizations/ceph/?query=029b4fa98a0f4b10b8dfaa8753f0dc69 reached maximum tries (301) after waiting for 300 seconds Dead ================================================================= [7346446] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346446/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346446/ Error reimaging machines: Failed to power on smithi032 [7346461] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346461/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346461/ Error reimaging machines: Expected smithi062's OS to be centos 8 but found rhel 8.6 [7346462] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346462/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346462/ Error reimaging machines: Expected smithi160's OS to be centos 8 but found rhel 8.6 [7346463] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346463/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346463/ Error reimaging machines: Failed to power on smithi057 [7346465] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346465/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346465/ Error reimaging machines: Failed to power on smithi057 [7346466] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346466/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346466/ Error reimaging machines: Cannot connect to remote host smithi062 [7346467] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346467/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346467/ Error reimaging machines: Expected smithi023's OS to be ubuntu 20.04 but found centos 8 [7346468] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346468/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346468/ Error reimaging machines: Failed to power on smithi184 [7346469] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346469/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346469/ Error reimaging machines: Expected smithi151's OS to be rhel 8.6 but found centos 8 [7346470] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346470/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346470/ Error reimaging machines: Failed to power on smithi170 [7346471] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346471/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346471/ Error reimaging machines: Failed to power on smithi088 [7346483] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346483/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346483/ Error reimaging machines: Failed to power on smithi192 [7346484] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346484/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346484/ Error reimaging machines: Cannot connect to remote host smithi181 [7346485] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346485/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346485/ Error reimaging machines: Expected smithi161's OS to be ubuntu 20.04 but found rhel 8.6 [7346486] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:03:13 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346486/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346486/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4228d7c50d3d4f019a6b7f4c5b283319 {'/dev/vg_nvme: already exists in filesystem', "Creating volume group 'vg_nvme' failed", "Run `vgcreate --help' for more information."} [7346487] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346487/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346487/ Error reimaging machines: Expected smithi092's OS to be centos 8 but found rhel 8.6 [7346489] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346489/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346489/ Error reimaging machines: Failed to power on smithi089 [7346517] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346517/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346517/ Error reimaging machines: Cannot connect to remote host smithi140 [7346518] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346518/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346518/ Error reimaging machines: Failed to power on smithi002 [7346519] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346519/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346519/ Error reimaging machines: Expected smithi154's OS to be rhel 8.6 but found centos 8 [7346520] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346520/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346520/ Error reimaging machines: Cannot connect to remote host smithi096 [7346521] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346521/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346521/ Error reimaging machines: Expected smithi167's OS to be centos 8 but found rhel 8.6 [7346522] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346522/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346522/ Error reimaging machines: Expected smithi133's OS to be rhel 8.6 but found centos 8 [7346534] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346534/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346534/ Error reimaging machines: Cannot connect to remote host smithi090 [7346535] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346535/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346535/ Error reimaging machines: Cannot connect to remote host smithi124 [7346536] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346536/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346536/ Error reimaging machines: Failed to power on smithi169 [7346537] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:02:11 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346537/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346537/ sentry: https://sentry.ceph.com/organizations/ceph/?query=63639f84d6bc4c99a6624876a8925f30 {'/dev/vg_nvme: already exists in filesystem', "Run `vgcreate --help' for more information.", "Creating volume group 'vg_nvme' failed"} [7346538] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346538/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346538/ Error reimaging machines: Expected smithi141's OS to be rhel 8.6 but found centos 8 [7346544] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346544/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346544/ Error reimaging machines: Cannot connect to remote host smithi096 [7346545] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346545/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346545/ Error reimaging machines: Failed to power on smithi140 Pass ================================================================= [7346439] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:51 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346439/ [7346441] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:34:35 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346441/ [7346442] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_nfs} time: 00:34:47 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346442/ [7346443] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:35:24 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346443/ [7346444] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:39:56 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346444/ [7346445] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} time: 00:23:43 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346445/ [7346447] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:13:50 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346447/ [7346448] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:54 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346448/ [7346450] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:47:36 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346450/ [7346451] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli} time: 00:24:17 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346451/ [7346452] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:23:02 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346452/ [7346453] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:23:52 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346453/ [7346454] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:50:22 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346454/ [7346455] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:49:49 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346455/ [7346456] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:41:10 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346456/ [7346457] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:22:20 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346457/ [7346458] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:29:10 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346458/ [7346459] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:27:40 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346459/ [7346460] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:31 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346460/ [7346464] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:25:22 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346464/ [7346472] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:34:52 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346472/ [7346473] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:02 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346473/ [7346475] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:22:25 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346475/ [7346476] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:19:36 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346476/ [7346477] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:42:20 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346477/ [7346478] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:08:06 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346478/ [7346479] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:18:32 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346479/ [7346480] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:38:57 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346480/ [7346481] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:22 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346481/ [7346482] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:33:32 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346482/ [7346488] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} time: 00:31:50 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346488/ [7346490] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:26:16 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346490/ [7346491] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:15:19 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346491/ [7346492] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:22:34 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346492/ [7346493] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:15 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346493/ [7346494] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:44:35 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346494/ [7346495] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:50:14 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346495/ [7346496] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:40:19 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346496/ [7346497] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:19:11 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346497/ [7346498] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:39:52 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346498/ [7346499] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} time: 00:29:22 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346499/ [7346500] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:18:07 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346500/ [7346501] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:14:30 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346501/ [7346503] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:35:13 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346503/ [7346504] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} time: 00:21:56 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346504/ [7346505] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:25:16 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346505/ [7346506] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} time: 00:33:19 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346506/ [7346507] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:21:10 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346507/ [7346508] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:19:01 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346508/ [7346509] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:21:51 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346509/ [7346510] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:09 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346510/ [7346511] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:48:06 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346511/ [7346512] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:40:33 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346512/ [7346513] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} time: 00:21:58 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346513/ [7346514] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:44:58 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346514/ [7346515] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:32:53 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346515/ [7346516] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm} time: 00:34:59 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346516/ [7346523] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 01:00:30 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346523/ [7346524] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:45:49 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346524/ [7346525] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:22:38 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346525/ [7346526] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:00 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346526/ [7346527] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:38 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346527/ [7346529] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:33 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346529/ [7346531] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:30:45 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346531/ [7346532] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_nfs} time: 00:40:10 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346532/ [7346533] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} time: 00:33:28 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346533/ [7346539] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:41:51 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346539/ [7346540] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:12 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346540/ [7346541] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:44 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346541/ [7346542] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:35:57 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346542/ [7346543] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:26:45 info: http://pulpito.ceph.com/gabrioux-2023-07-21_06:58:37-orch:cephadm-wip-guits-testing-2-2023-07-21-0244-distro-default-smithi/7346543/