2022-06-28T00:18:02.614 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-28T00:18:02.616 INFO:teuthology.results:subset: '1/999' 2022-06-28T00:18:02.616 INFO:teuthology.results:seed: '7397' 2022-06-28T02:31:51.137 INFO:root:teuthology version: 1.1.1.dev376+g082ae7ef 2022-06-28T02:31:51.359 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-06-28T14:31:52.607 WARNING:teuthology.results:test(s) did not finish before timeout of 43200 seconds 2022-06-28T14:31:58.153 INFO:scrape:Found 65 jobs 2022-06-28T14:32:06.523 INFO:scrape:Found 9 distinct failure reasons 2022-06-28T14:32:06.524 INFO:scrape:Failure: Command failed on smithi074 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f87b43ee-f679-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi074:vg_nvme/lv_4' 2022-06-28T14:32:06.525 INFO:scrape:23 jobs: ['6901250', '6901266', '6901254', '6901304', '6901251', '6901283', '6901306', '6901277', '6901274', '6901255', '6901295', '6901261', '6901286', '6901268', '6901282', '6901296', '6901293', '6901287', '6901276', '6901264', '6901309', '6901273', '6901305'] 2022-06-28T14:32:06.525 INFO:scrape:suites intersection: [] 2022-06-28T14:32:06.526 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/basic', '2-services/rgw', '2-thrash', '3-final}', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', 'agent/off', 'agent/on', 'base/install', 'cluster/{fixed-3', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'openstack}', 'orch:cephadm/rbd_iscsi/{0-single-container-host', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun}', 'orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools}', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/smoke/{0-distro/ubuntu_20.04', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/thrash/{0-distro/ubuntu_20.04', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'orch:cephadm/workunits/{agent/off', 'orch:cephadm/workunits/{agent/on', 'root}', 'start', 'start}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'task/test_nfs}', 'task/test_orch_cli}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'test_iscsi_pids_limit}}', 'workloads/cephadm_iscsi}'] 2022-06-28T14:32:06.527 INFO:scrape: 2022-06-28T14:32:06.527 INFO:scrape:Failure: reached maximum tries (300) after waiting for 300 seconds 2022-06-28T14:32:06.527 INFO:scrape:6 jobs: ['6901258', '6901307', '6901272', '6901275', '6901278', '6901265'] 2022-06-28T14:32:06.528 INFO:scrape:suites intersection: ['1-start'] 2022-06-28T14:32:06.528 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/16.2.5', '1-start', '2-nfs', '2-services/nfs', '2-services/nfs-ingress', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs2', '3-final}', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8'] 2022-06-28T14:32:06.529 INFO:scrape: 2022-06-28T14:32:06.529 INFO:scrape:Failure: Command failed on smithi022 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.22:/fake /mnt/foo -o port=2999'" 2022-06-28T14:32:06.530 INFO:scrape:1 jobs: ['6901269'] 2022-06-28T14:32:06.530 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress2', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04'] 2022-06-28T14:32:06.531 INFO:scrape: 2022-06-28T14:32:06.531 INFO:scrape:Dead: b'2022-06-28T12:28:02.297 DEBUG:teuthology.exit:Finished running handlers' 2022-06-28T14:32:06.532 INFO:scrape:1 jobs: ['6901252'] 2022-06-28T14:32:06.532 INFO:scrape:suites: ['1-bootstrap/16.2.4', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2022-06-28T14:32:06.532 INFO:scrape: 2022-06-28T14:32:06.533 INFO:scrape:Failure: Command failed on smithi070 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9f9d3b34-f68c-11ec-842c-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nHOST=$(hostname -s)\nOSD=$(ceph orch ps $HOST | grep osd | head -n 1 | awk \'"\'"\'{print $1}\'"\'"\')\necho "host $HOST, osd $OSD"\nceph orch daemon stop $OSD\nwhile ceph orch ps | grep $OSD | grep running ; do sleep 5 ; done\nceph auth export $OSD > k\nceph orch daemon rm $OSD --force\nceph orch ps --refresh\nwhile ceph orch ps | grep $OSD ; do sleep 5 ; done\nceph auth add $OSD -i k\nceph cephadm osd activate $HOST\nwhile ! ceph orch ps | grep $OSD | grep running ; do sleep 5 ; done\n\'' 2022-06-28T14:32:06.533 INFO:scrape:3 jobs: ['6901279', '6901247', '6901302'] 2022-06-28T14:32:06.534 INFO:scrape:suites intersection: ['0-nvme-loop', '1-start'] 2022-06-28T14:32:06.534 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', '2-ops/rmdir-reactivate}', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/osds/{0-distro/ubuntu_20.04'] 2022-06-28T14:32:06.535 INFO:scrape: 2022-06-28T14:32:06.535 INFO:scrape:Failure: {'smithi087.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}, 'smithi112.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer-latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}} 2022-06-28T14:32:06.536 INFO:scrape:4 jobs: ['6901262', '6901253', '6901263', '6901257'] 2022-06-28T14:32:06.536 INFO:scrape:suites intersection: [] 2022-06-28T14:32:06.537 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-node-mgr', '2-services/nfs-ingress-rgw-user', '2-thrash', '3-final}', '3-tasks/snaps-few-objects', 'agent/off', 'agent/on', 'fixed-2', 'mon_election/connectivity', 'msgr/async-v2only', 'orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0}', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0', 'orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0', 'orchestrator_cli}', 'root}', 'start}'] 2022-06-28T14:32:06.537 INFO:scrape: 2022-06-28T14:32:06.537 INFO:scrape:Dead: b'2022-06-28T14:32:01.392 INFO:journalctl@ceph.mon.smithi121.smithi121.stdout:Jun 28 14:32:01 smithi121 ceph-mon[59359]: from=\'mgr.34100 172.21.15.83:0/2071608552\' entity=\'mgr.smithi083.juzggo\' cmd=[{"prefix": "mon metadata", "id": "smithi121"}]: dispatch' 2022-06-28T14:32:06.538 INFO:scrape:1 jobs: ['6901297'] 2022-06-28T14:32:06.538 INFO:scrape:suites: ['1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2022-06-28T14:32:06.539 INFO:scrape: 2022-06-28T14:32:06.539 INFO:scrape:Failure: {'smithi146.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2022-06-28T14:32:06.540 INFO:scrape:1 jobs: ['6901270'] 2022-06-28T14:32:06.541 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-wait}', 'orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0'] 2022-06-28T14:32:06.541 INFO:scrape: 2022-06-28T14:32:06.541 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi154 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6815a256a07bf14ab703757b4e123bd2bc9f6e8a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2022-06-28T14:32:06.542 INFO:scrape:1 jobs: ['6901292'] 2022-06-28T14:32:06.542 INFO:scrape:suites: ['mon_election/connectivity', 'orch:cephadm/workunits/{agent/off', 'task/test_cephadm}'] 2022-06-28T14:32:06.543 INFO:scrape: 2022-06-28T14:32:06.545 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/ failed: 34 dead: 6 running: 1 waiting: 0 queued: 0 passed: 24 Fail ================================================================= [6901247] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:11:53 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901247/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901247/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2542821b03404cadbb5556d72954878f Command failed on smithi163 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a31b489a-f679-11ec-842c-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [6901250] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:09:58 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901250/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901250/ sentry: https://sentry.ceph.com/organizations/ceph/?query=90ed32c641c54443b9e29af09e61396a Command failed on smithi074 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f87b43ee-f679-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi074:vg_nvme/lv_4' [6901251] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:09:48 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901251/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901251/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c98fa8e610b24b5bbb80e265b753afc4 Command failed on smithi079 with status 22: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid bfaa140a-f679-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi079:vg_nvme/lv_4' [6901254] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} ----------------------------------------------------------------- time: 00:07:51 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901254/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901254/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b125fbe734f249e2a8985e75941a5690 Command failed on smithi133 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a37498aa-f679-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi133:vg_nvme/lv_4' [6901255] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901255/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901255/ sentry: https://sentry.ceph.com/organizations/ceph/?query=38712c070c284eccb2c498f6b2b414ac Command failed on smithi109 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 587399c8-f679-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi109:vg_nvme/lv_4' [6901258] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:28:59 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901258/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901258/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d1c69a930dd2465e825728d37f835f1e reached maximum tries (300) after waiting for 300 seconds [6901261] orch:cephadm/workunits/{agent/on mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:09:19 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901261/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901261/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a7781d271dff4c839dc876c27fa7fc02 Command failed on smithi008 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid b6ad5e98-f679-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi008:vg_nvme/lv_4' [6901264] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:15:14 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901264/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901264/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06f14853b91d400ebabdec7e15715f68 Command failed on smithi038 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 5606b45e-f68d-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi038:vg_nvme/lv_4' [6901265] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:35:29 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901265/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901265/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d69c4d430bf04d0ebf5fd28053fdad64 reached maximum tries (300) after waiting for 300 seconds [6901266] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:09:27 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901266/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901266/ sentry: https://sentry.ceph.com/organizations/ceph/?query=13f783db875646c4905374ec6137b466 Command failed on smithi073 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 117afe2c-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi073:/dev/nvme4n1' [6901268] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:12:40 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901268/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901268/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ddbbad74c73e4c36aed370397b736083 Command failed on smithi092 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8f8eb4c0-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi092:vg_nvme/lv_4' [6901269] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:26:26 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901269/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901269/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3e071a29a55a478b9c8634d8227a5e2e Command failed on smithi022 with status 32: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mount -t nfs 10.0.31.22:/fake /mnt/foo -o port=2999'" [6901272] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:31:14 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901272/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901272/ sentry: https://sentry.ceph.com/organizations/ceph/?query=37efc8a6734249e1bee742c068537f37 reached maximum tries (300) after waiting for 300 seconds [6901273] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:14:27 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901273/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901273/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11c57ba26e4745b58c77fd59317092e1 Command failed on smithi156 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fba39ac-f68d-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi156:vg_nvme/lv_4' [6901274] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:14:01 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901274/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901274/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fee8fea324794c3ca53fc693c1377536 Command failed on smithi037 with status 22: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6fef6088-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi037:vg_nvme/lv_4' [6901275] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:45:08 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901275/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901275/ sentry: https://sentry.ceph.com/organizations/ceph/?query=22c17ac115764cc3833f7a239b5f8943 reached maximum tries (300) after waiting for 300 seconds [6901276] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:09:35 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901276/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901276/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1f88decf67664fe69e1c59e06e9e883c Command failed on smithi101 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c0146c8e-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi101:/dev/nvme4n1' [6901277] orch:cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:11:48 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901277/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901277/ sentry: https://sentry.ceph.com/organizations/ceph/?query=674619d0d2734d2e8d19478bef7f113f Command failed on smithi062 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d05635aa-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi062:vg_nvme/lv_4' [6901278] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:29:39 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901278/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901278/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8e816a78f03043beb5d66f94c3e6ebeb reached maximum tries (300) after waiting for 300 seconds [6901279] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:14:49 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901279/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901279/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a10cda444b234cc69ffe98c66b8a7148 Command failed on smithi070 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9f9d3b34-f68c-11ec-842c-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nHOST=$(hostname -s)\nOSD=$(ceph orch ps $HOST | grep osd | head -n 1 | awk \'"\'"\'{print $1}\'"\'"\')\necho "host $HOST, osd $OSD"\nceph orch daemon stop $OSD\nwhile ceph orch ps | grep $OSD | grep running ; do sleep 5 ; done\nceph auth export $OSD > k\nceph orch daemon rm $OSD --force\nceph orch ps --refresh\nwhile ceph orch ps | grep $OSD ; do sleep 5 ; done\nceph auth add $OSD -i k\nceph cephadm osd activate $HOST\nwhile ! ceph orch ps | grep $OSD | grep running ; do sleep 5 ; done\n\'' [6901282] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:13:31 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901282/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901282/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3e7482391d2640618f72606289cee913 Command failed on smithi017 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c8e7f650-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi017:vg_nvme/lv_4' [6901283] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:12:43 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901283/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901283/ sentry: https://sentry.ceph.com/organizations/ceph/?query=73ef3f36bd37459687ddbc42b8c0931f Command failed on smithi103 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e8473ba0-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi103:vg_nvme/lv_4' [6901286] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:09:06 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901286/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901286/ sentry: https://sentry.ceph.com/organizations/ceph/?query=88e7623733d6453484ada7cc6dea9f67 Command failed on smithi047 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1605cc6a-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi047:/dev/nvme4n1' [6901287] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:07:15 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901287/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901287/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0339262b4a684661807255ff0de1682f Command failed on smithi026 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae4a25ee-f68b-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi026:vg_nvme/lv_4' [6901292] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:17:35 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901292/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901292/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1bb84153468b4d72b39273c1067da51e Command failed (workunit test cephadm/test_cephadm.sh) on smithi154 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6815a256a07bf14ab703757b4e123bd2bc9f6e8a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [6901293] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:10:18 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901293/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901293/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3fb9e0c98712467b97da72d173b61eda Command failed on smithi064 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 527d1112-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi064:/dev/nvme4n1' [6901295] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:11:59 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901295/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901295/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ad7723f8711457ab99b0cd72949a806 Command failed on smithi120 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 08e4954c-f68d-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi120:vg_nvme/lv_4' [6901296] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:12:13 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901296/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901296/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2fcb45f0bf1f4819940cfee7c6fffdbe Command failed on smithi107 with status 22: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c7cb84c6-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi107:vg_nvme/lv_4' [6901302] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:21:04 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901302/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901302/ sentry: https://sentry.ceph.com/organizations/ceph/?query=963fcaa302394e8ab03fb760d9a38c43 Command failed on smithi050 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a4a396fa-f68c-11ec-842c-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [6901304] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:11:27 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901304/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901304/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc44ffd2b8a7406bb6a09c3c01d9be80 Command failed on smithi008 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid a186ef6c-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi008:/dev/nvme4n1' [6901305] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:12:06 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901305/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901305/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76e8c996ee004d7abccbcaa59b668cf8 Command failed on smithi133 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f32d9618-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi133:vg_nvme/lv_4' [6901306] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:12:07 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901306/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901306/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3cb02135d83447aca548c4b1e81f74d6 Command failed on smithi109 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid edd0a1b0-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi109:vg_nvme/lv_4' [6901307] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:32:54 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901307/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901307/ sentry: https://sentry.ceph.com/organizations/ceph/?query=85e8d363e0b648b0b8271b17bb3758be reached maximum tries (300) after waiting for 300 seconds [6901309] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:11:21 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901309/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901309/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1fd76e7252b44b078bebef5e8a820e3d Command failed on smithi203 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6815a256a07bf14ab703757b4e123bd2bc9f6e8a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 58ce0486-f68c-11ec-842c-001a4aab830c -- ceph orch daemon add osd smithi203:vg_nvme/lv_4' Dead ================================================================= [6901252] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901252/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901252/ hit max job timeout [6901253] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901253/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901253/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8b9a6f1ca3a443a487b3cae9bf40a7a7 {'smithi203.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}, 'smithi003.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}} [6901257] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:10 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901257/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901257/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b7d94adfe264870b3ed27d76afbf919 {'smithi153.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}, 'smithi119.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}} [6901262] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:04:06 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901262/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901262/ sentry: https://sentry.ceph.com/organizations/ceph/?query=12d9e9ed5d294adebaa6cae0c8830cb6 {'smithi087.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}, 'smithi112.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}} [6901263] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:03:40 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901263/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901263/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd30720d501743b48dbf1510b27aea96 {'smithi145.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}, 'smithi050.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'invocation': {'module_args': {'allow_downgrade': False, 'allowerasing': False, 'autoremove': False, 'bugfix': False, 'conf_file': None, 'disable_excludes': None, 'disable_gpg_check': False, 'disable_plugin': [], 'disablerepo': [], 'download_dir': None, 'download_only': False, 'enable_plugin': [], 'enablerepo': [], 'exclude': [], 'install_repoquery': True, 'install_weak_deps': True, 'installroot': '/', 'list': None, 'lock_timeout': 30, 'name': ['http://satellite.front.sepia.ceph.com/pub/katello-ca-consumer- latest.noarch.rpm'], 'releasever': None, 'security': False, 'skip_broken': False, 'state': 'present', 'update_cache': False, 'update_only': False, 'validate_certs': False}}, 'msg': 'Failed to validate GPG signature for katello-ca-consumer-satellite.front.sepia.ceph.com-1.0-4.noarch'}} [6901270] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:05:53 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901270/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901270/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d9dabdb02664eb697fed4abe070866b {'smithi146.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} Running ================================================================= [6901297] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901297/ Pass ================================================================= [6901246] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:38 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901246/ [6901248] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:33:50 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901248/ [6901249] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:12:48 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901249/ [6901256] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:04:26 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901256/ [6901259] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:27 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901259/ [6901260] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:00 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901260/ [6901267] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:54:40 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901267/ [6901271] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:40 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901271/ [6901280] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:22:20 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901280/ [6901281] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:27:18 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901281/ [6901284] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:00 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901284/ [6901285] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} time: 00:14:35 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901285/ [6901288] orch:cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:09:41 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901288/ [6901289] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:06 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901289/ [6901290] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:11 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901290/ [6901291] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:12 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901291/ [6901294] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:01 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901294/ [6901298] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:35 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901298/ [6901299] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:49 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901299/ [6901300] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:55:15 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901300/ [6901301] orch:cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:05:57 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901301/ [6901303] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:32 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901303/ [6901308] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:22 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901308/ [6901310] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:08 info: http://pulpito.ceph.com/gabrioux-2022-06-27_18:03:27-orch:cephadm-wip-guits-testing-2022-06-27-1413-distro-default-smithi/6901310/