2022-12-22T22:07:46.747 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-22T22:07:46.747 INFO:teuthology.results:subset: '111/120000' 2022-12-22T22:07:46.747 INFO:teuthology.results:seed: '8610' 2022-12-23T01:10:34.950 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-23T01:10:34.959 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-12-23T03:21:46.091 INFO:teuthology.results:Tests finished! gathering results... 2022-12-23T03:21:58.751 INFO:scrape:Found 173 jobs 2022-12-23T03:22:00.628 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125705/teuthology.log 2022-12-23T03:22:00.628 INFO:scrape:Found 7 distinct failure reasons 2022-12-23T03:22:00.629 INFO:scrape:Failure: Command failed on smithi146 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97a18eaa-824e-11ed-97ac-001a4aab830c -- ceph mon dump -f json' 2022-12-23T03:22:00.629 INFO:scrape:3 jobs: ['7125536', '7125598', '7125580'] 2022-12-23T03:22:00.629 INFO:scrape:suites intersection: [] 2022-12-23T03:22:00.629 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/mirror', '2-services/rgw-ingress', '3-final}', 'distro/rhel_8.4_container_tools_rhel8', 'fixed-2', 'mon_election/connectivity', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'orch/cephadm/smoke/{0-nvme-loop', 'start}'] 2022-12-23T03:22:00.629 INFO:scrape: 2022-12-23T03:22:00.629 INFO:scrape:Failure: Command failed on smithi102 with status 1: 'sudo kubeadm init --node-name smithi102 --token abcdef.dz3ckrzpj50xrttg --pod-network-cidr 10.251.40.0/21' 2022-12-23T03:22:00.630 INFO:scrape:3 jobs: ['7125706', '7125596', '7125488'] 2022-12-23T03:22:00.630 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '3-final', 'k8s/1.21', 'net/calico'] 2022-12-23T03:22:00.630 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'orch/rook/smoke/{0-distro/ubuntu_18.04', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.6.2}', 'rook/master}'] 2022-12-23T03:22:00.630 INFO:scrape: 2022-12-23T03:22:00.630 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2022-12-23T03:22:00.630 INFO:scrape:4 jobs: ['7125558', '7125475', '7125720', '7125651'] 2022-12-23T03:22:00.631 INFO:scrape:suites intersection: ['orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-12-23T03:22:00.631 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-12-23T03:22:00.631 INFO:scrape: 2022-12-23T03:22:00.631 INFO:scrape:Failure: Command failed on smithi045 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d9407c0-825f-11ed-97ac-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2022-12-23T03:22:00.631 INFO:scrape:1 jobs: ['7125719'] 2022-12-23T03:22:00.631 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'orch/cephadm/osds/{0-distro/ubuntu_18.04'] 2022-12-23T03:22:00.631 INFO:scrape: 2022-12-23T03:22:00.632 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2022-12-23T03:22:00.632 INFO:scrape:2 jobs: ['7125446', '7125621'] 2022-12-23T03:22:00.632 INFO:scrape:suites intersection: ['orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'task/test_e2e}'] 2022-12-23T03:22:00.632 INFO:scrape:suites union: ['orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'task/test_e2e}'] 2022-12-23T03:22:00.632 INFO:scrape: 2022-12-23T03:22:00.632 INFO:scrape:Failure: {'smithi190.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.441469', 'end': '2022-12-23 01:07:20.348544', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-23 01:07:15.907075', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}, 'smithi176.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.278285', 'end': '2022-12-23 01:07:20.368907', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-23 01:07:16.090622', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}} 2022-12-23T03:22:00.633 INFO:scrape:2 jobs: ['7125709', '7125538'] 2022-12-23T03:22:00.633 INFO:scrape:suites intersection: ['orch/cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}'] 2022-12-23T03:22:00.633 INFO:scrape:suites union: ['orch/cephadm/dashboard/{0-distro/ignorelist_health', 'task/test_e2e}'] 2022-12-23T03:22:00.633 INFO:scrape: 2022-12-23T03:22:00.633 INFO:scrape:Dead: None 2022-12-23T03:22:00.633 INFO:scrape:1 jobs: ['7125705'] 2022-12-23T03:22:00.634 INFO:scrape: 2022-12-23T03:22:00.639 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/ failed: 13 dead: 3 running: 0 waiting: 0 queued: 0 passed: 157 Fail ================================================================= [7125446] orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:23:30 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125446/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125446/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b55dfa7edd8643ee80b4493281a73714 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi008 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7125475] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:11:57 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125475/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125475/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9a6e09247daf43049609233b17a06b9f Command failed (workunit test cephadm/test_cephadm.sh) on smithi040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7125488] orch/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:07:56 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125488/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125488/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a2bed0aaf21047f8ad66428b476f4923 Command failed on smithi039 with status 1: 'sudo kubeadm init --node-name smithi039 --token abcdef.i8mbkebhcx1ttcvo --pod-network-cidr 10.249.48.0/21' [7125536] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:07:16 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125536/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125536/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e7077c7108546a8b3db90c59910d6e0 Command failed on smithi146 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 97a18eaa-824e-11ed-97ac-001a4aab830c -- ceph mon dump -f json' [7125558] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:11:17 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125558/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125558/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9ccdfe57f7034a2384bea8ccf220afea Command failed (workunit test cephadm/test_cephadm.sh) on smithi112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7125580] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:07:05 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125580/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125580/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2deebb130c27476a93c0aa12f2cb29a7 Command failed on smithi081 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8fc942d2-8252-11ed-97ac-001a4aab830c -- ceph mon dump -f json' [7125596] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:07:57 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125596/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125596/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d6263284a404413a8cd8aef12faca0e2 Command failed on smithi016 with status 1: 'sudo kubeadm init --node-name smithi016 --token abcdef.41t5c0xiy5mgxj6t --pod-network-cidr 10.248.120.0/21' [7125598] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125598/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125598/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8ce177a5e33a42e0a8ebdbd3b6068b71 Command failed on smithi170 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f579e9d2-8253-11ed-97ac-001a4aab830c -- ceph mon dump -f json' [7125621] orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:24:21 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125621/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125621/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1fddc5cd02b84133a0e25db8e51346c3 Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi046 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [7125651] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:11:19 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125651/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125651/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a9814db1d6fc4a5c81f0f41d5691633c Command failed (workunit test cephadm/test_cephadm.sh) on smithi195 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7125706] orch/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} ----------------------------------------------------------------- time: 00:07:25 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125706/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125706/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7ef52d638ec8457fb78fb9873f98ddb5 Command failed on smithi102 with status 1: 'sudo kubeadm init --node-name smithi102 --token abcdef.dz3ckrzpj50xrttg --pod-network-cidr 10.251.40.0/21' [7125719] orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:15:28 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125719/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125719/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b6652f3b5e7d480394230013f717a737 Command failed on smithi045 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:22be1b8fdf3b0a37691ef6abcf04f7c57402534b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2d9407c0-825f-11ed-97ac-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [7125720] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:11:43 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125720/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125720/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3c1f65cf53ab42aaabe81767b685b74b Command failed (workunit test cephadm/test_cephadm.sh) on smithi005 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=22be1b8fdf3b0a37691ef6abcf04f7c57402534b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' Dead ================================================================= [7125538] orch/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} ----------------------------------------------------------------- time: 00:03:57 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125538/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125538/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fef632dad79f4015a114b6d229d58f80 {'smithi154.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.163554', 'end': '2022-12-22 23:18:13.939310', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-22 23:18:09.775756', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/. cpan/sources/authors/01mailrc.txt.gz'\n.................................... ........................................DONE\nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n...... ......................................................................DONE\ nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '................... .........................................................DONE', 'Fetching with LWP:', 'http://apt- mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................ ................DONE', 'Fetching with LWP:', 'http://apt- mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}, 'smithi052.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.258490', 'end': '2022-12-22 23:18:17.001882', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-22 23:18:12.743392', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/. cpan/sources/authors/01mailrc.txt.gz'\n.................................... ........................................DONE\nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n...... ......................................................................DONE\ nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '................... .........................................................DONE', 'Fetching with LWP:', 'http://apt- mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................ ................DONE', 'Fetching with LWP:', 'http://apt- mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}} [7125705] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125705/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125705/ Error reimaging machines: reached maximum tries (100) after waiting for 600 seconds [7125709] orch/cephadm/dashboard/{0-distro/ignorelist_health task/test_e2e} ----------------------------------------------------------------- time: 00:04:02 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125709/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125709/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad55000941db4535877b8ed3730fbe57 {'smithi190.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.441469', 'end': '2022-12-23 01:07:20.348544', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-23 01:07:15.907075', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/. cpan/sources/authors/01mailrc.txt.gz'\n.................................... ........................................DONE\nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n...... ......................................................................DONE\ nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '................... .........................................................DONE', 'Fetching with LWP:', 'http://apt- mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................ ................DONE', 'Fetching with LWP:', 'http://apt- mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}, 'smithi176.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.278285', 'end': '2022-12-23 01:07:20.368907', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-23 01:07:16.090622', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/. cpan/sources/authors/01mailrc.txt.gz'\n.................................... ........................................DONE\nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2505 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n...... ......................................................................DONE\ nFetching with LWP:\nhttp://apt- mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '................... .........................................................DONE', 'Fetching with LWP:', 'http://apt- mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2505 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................ ................DONE', 'Fetching with LWP:', 'http://apt- mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}} Pass ================================================================= [7125426] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:15:31 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125426/ [7125431] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:16:14 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125431/ [7125434] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:33:00 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125434/ [7125437] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:34:17 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125437/ [7125439] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:23:55 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125439/ [7125441] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} time: 00:27:39 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125441/ [7125442] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:17:43 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125442/ [7125444] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:45 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125444/ [7125449] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:01 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125449/ [7125451] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:32:01 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125451/ [7125453] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:11:16 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125453/ [7125455] orch/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:40:30 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125455/ [7125457] orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:17:28 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125457/ [7125459] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:15:46 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125459/ [7125460] orch/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:12:54 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125460/ [7125462] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:33:37 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125462/ [7125464] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:53:32 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125464/ [7125467] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:35:05 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125467/ [7125469] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:12:23 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125469/ [7125471] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:44:50 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125471/ [7125472] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:14:22 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125472/ [7125476] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:15:18 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125476/ [7125478] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:36:47 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125478/ [7125481] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125481/ [7125482] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:28 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125482/ [7125484] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125484/ [7125486] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:39:49 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125486/ [7125490] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:24:34 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125490/ [7125492] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:08:51 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125492/ [7125494] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125494/ [7125496] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:20:33 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125496/ [7125498] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:36:43 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125498/ [7125500] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:45 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125500/ [7125502] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:27:20 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125502/ [7125504] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:27:39 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125504/ [7125507] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:23:02 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125507/ [7125508] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:02 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125508/ [7125510] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:22:17 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125510/ [7125512] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:29:37 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125512/ [7125514] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:15:28 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125514/ [7125516] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:43:12 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125516/ [7125518] orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:40:41 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125518/ [7125520] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:17:27 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125520/ [7125522] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:52:20 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125522/ [7125524] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:34 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125524/ [7125527] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:23:56 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125527/ [7125528] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:12:50 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125528/ [7125530] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli_mon} time: 00:27:40 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125530/ [7125532] orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:19 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125532/ [7125534] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:25:13 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125534/ [7125540] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:31 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125540/ [7125542] orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:17:35 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125542/ [7125544] orch/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:11:49 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125544/ [7125546] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:52:41 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125546/ [7125548] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/classic} time: 00:54:15 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125548/ [7125550] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:31:02 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125550/ [7125552] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:12:14 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125552/ [7125554] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:17:43 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125554/ [7125556] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:43:40 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125556/ [7125560] orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:22 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125560/ [7125562] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:36 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125562/ [7125564] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:16:53 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125564/ [7125566] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:51 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125566/ [7125569] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:33:14 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125569/ [7125571] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:53 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125571/ [7125573] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:34:08 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125573/ [7125575] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:36:53 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125575/ [7125577] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125577/ [7125579] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:58:14 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125579/ [7125583] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:13:28 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125583/ [7125585] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:48 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125585/ [7125587] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:32:04 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125587/ [7125588] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:27:18 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125588/ [7125591] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:19 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125591/ [7125593] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:37:20 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125593/ [7125595] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:21:55 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125595/ [7125600] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:40:27 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125600/ [7125602] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:25:12 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125602/ [7125604] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:15:51 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125604/ [7125606] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:18:34 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125606/ [7125608] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:11 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125608/ [7125610] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:51:14 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125610/ [7125612] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:24:09 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125612/ [7125615] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli_mon} time: 00:27:36 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125615/ [7125616] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:21 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125616/ [7125619] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:41 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125619/ [7125623] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:22 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125623/ [7125625] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:32:43 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125625/ [7125627] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr orchestrator_cli} time: 00:13:37 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125627/ [7125628] orch/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} time: 00:15:56 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125628/ [7125631] orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:17:52 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125631/ [7125632] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:25 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125632/ [7125634] orch/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/basic 3-final} time: 00:14:45 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125634/ [7125636] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:37:36 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125636/ [7125639] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:27:03 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125639/ [7125641] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:36:12 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125641/ [7125643] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:12:35 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125643/ [7125645] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:35:08 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125645/ [7125647] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:53 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125647/ [7125649] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:12:51 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125649/ [7125652] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:16:04 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125652/ [7125654] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:36:01 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125654/ [7125657] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:26 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125657/ [7125659] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:13:19 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125659/ [7125661] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:52:40 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125661/ [7125663] orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:29:28 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125663/ [7125665] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:08:44 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125665/ [7125666] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:15:33 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125666/ [7125669] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:21 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125669/ [7125671] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:24:18 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125671/ [7125672] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:14:09 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125672/ [7125674] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:33:35 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125674/ [7125676] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:53:43 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125676/ [7125679] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:27:46 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125679/ [7125681] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:24:05 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125681/ [7125683] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:21:55 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125683/ [7125685] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:36:12 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125685/ [7125687] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:31:03 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125687/ [7125689] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:52 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125689/ [7125691] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:34:49 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125691/ [7125693] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:42:18 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125693/ [7125695] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:15:55 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125695/ [7125696] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:39 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125696/ [7125698] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:30 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125698/ [7125701] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:24:17 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125701/ [7125703] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:12:04 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125703/ [7125707] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 01:00:41 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125707/ [7125708] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:13:01 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125708/ [7125710] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125710/ [7125711] orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:17:44 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125711/ [7125712] orch/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:11:53 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125712/ [7125713] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:38:39 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125713/ [7125714] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} time: 00:32:00 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125714/ [7125715] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:26:05 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125715/ [7125716] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:12:18 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125716/ [7125717] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:16:22 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125717/ [7125718] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:33:53 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125718/ [7125721] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:15:19 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125721/ [7125722] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:48 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125722/ [7125723] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:56 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125723/ [7125724] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:36:11 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125724/ [7125725] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:32:26 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125725/ [7125726] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:05 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125726/ [7125727] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:37:33 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125727/ [7125728] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:35:07 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125728/ [7125729] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:08:51 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125729/ [7125730] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:15:20 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125730/ [7125731] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:13 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125731/ [7125732] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125732/ [7125733] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:13 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125733/ [7125734] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:46:52 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125734/ [7125735] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:27:18 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125735/ [7125736] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 02:05:30 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125736/ [7125737] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125737/ [7125738] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:07 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125738/ [7125739] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:54:52 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125739/ [7125740] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:49 info: http://pulpito.ceph.com/yuriw-2022-12-22_21:14:13-orch-pacific_16.2.11_RC3-distro-default-smithi/7125740/