2022-04-19T01:17:38.015 INFO:root:teuthology version: 1.1.0-b21f9558 2022-04-19T01:17:38.015 INFO:teuthology.results:subset: '111/120000' 2022-04-19T01:17:38.015 INFO:teuthology.results:seed: '8075' 2022-04-19T03:35:08.152 INFO:root:teuthology version: 1.1.0-b21f9558 2022-04-19T03:35:08.174 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-19T05:26:17.036 INFO:teuthology.results:Tests finished! gathering results... 2022-04-19T05:26:29.017 INFO:scrape:Found 167 jobs 2022-04-19T05:26:30.423 INFO:scrape:Found 7 distinct failure reasons 2022-04-19T05:26:30.424 INFO:scrape:Failure: Command failed on smithi093 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 669b716a-bf83-11ec-8c38-001a4aab830c -e sha1=2194423fe78ea1121b8a233f4f8fc979c1532a43 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2022-04-19T05:26:30.424 INFO:scrape:5 jobs: ['6795731', '6795706', '6795901', '6795670', '6795785'] 2022-04-19T05:26:30.424 INFO:scrape:suites intersection: ['3-upgrade-with-workload'] 2022-04-19T05:26:30.424 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/octopus', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '2-nfs', '3-inline/yes', '3-upgrade-with-workload', '4-final}', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'osd}', 'overrides/{pg-warn', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-19T05:26:30.424 INFO:scrape: 2022-04-19T05:26:30.425 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi007.front.sepia.ceph.com: ['type=AVC msg=audit(1650338899.819:7627): avc: denied { ioctl } for pid=50894 comm="iptables" path="/var/lib/containers/storage/overlay/7c834d31fc57402d9fd3eb9a37c5b987eaa9eea8e303f07070a3e80d16462965/merged" dev="overlay" ino=3408018 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2022-04-19T05:26:30.425 INFO:scrape:2 jobs: ['6795895', '6795683'] 2022-04-19T05:26:30.425 INFO:scrape:suites intersection: ['orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-04-19T05:26:30.425 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm}'] 2022-04-19T05:26:30.425 INFO:scrape: 2022-04-19T05:26:30.425 INFO:scrape:Failure: Command failed (workunit test cephadm/test_repos.sh) on smithi116 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2194423fe78ea1121b8a233f4f8fc979c1532a43 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' 2022-04-19T05:26:30.425 INFO:scrape:4 jobs: ['6795911', '6795829', '6795693', '6795743'] 2022-04-19T05:26:30.426 INFO:scrape:suites intersection: ['orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm_repos}'] 2022-04-19T05:26:30.426 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_cephadm_repos}'] 2022-04-19T05:26:30.426 INFO:scrape: 2022-04-19T05:26:30.426 INFO:scrape:Failure: Command failed on smithi158 with status 100: 'sudo apt-get clean' 2022-04-19T05:26:30.426 INFO:scrape:1 jobs: ['6795751'] 2022-04-19T05:26:30.426 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'orch/cephadm/osds/{0-distro/ubuntu_20.04'] 2022-04-19T05:26:30.426 INFO:scrape: 2022-04-19T05:26:30.427 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi081.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' 2022-04-19T05:26:30.427 INFO:scrape:1 jobs: ['6795759'] 2022-04-19T05:26:30.427 INFO:scrape:suites: ['0-kubeadm', '1-rook', '2-workload/radosbench', '3-final', 'cluster/1-node', 'k8s/1.21', 'net/calico', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-04-19T05:26:30.427 INFO:scrape: 2022-04-19T05:26:30.427 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2022-04-19T05:26:30.427 INFO:scrape:1 jobs: ['6795720'] 2022-04-19T05:26:30.427 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/rgw', '3-final}', 'orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04'] 2022-04-19T05:26:30.427 INFO:scrape: 2022-04-19T05:26:30.428 INFO:scrape:Failure: Command failed on smithi035 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:2194423fe78ea1121b8a233f4f8fc979c1532a43 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57689298-bf8f-11ec-8c38-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2022-04-19T05:26:30.428 INFO:scrape:1 jobs: ['6795889'] 2022-04-19T05:26:30.428 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-add}', 'orch/cephadm/osds/{0-distro/ubuntu_18.04'] 2022-04-19T05:26:30.428 INFO:scrape: 2022-04-19T05:26:30.434 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/ failed: 15 dead: 0 running: 0 waiting: 0 queued: 0 passed: 152 Fail ================================================================= [6795670] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:21:32 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795670/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795670/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01aeefa9c7934919b3666467417be9cc Command failed on smithi036 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid e64d4004-bf7f-11ec-8c38-001a4aab830c -e sha1=2194423fe78ea1121b8a233f4f8fc979c1532a43 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6795683] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:15:48 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795683/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795683/ SELinux denials found on ubuntu@smithi183.front.sepia.ceph.com: ['type=AVC msg=audit(1650332523.841:7643): avc: denied { ioctl } for pid=50941 comm="iptables" path="/var/lib/containers/storage/overlay/f34481cd19d57e818 4fc2b8ea06d5e775760bd8d5f496b352af6495014b62ad0/merged" dev="overlay" ino=3408018 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1', 'type=AVC msg=audit(1650332523.956:7645): avc: denied { ioctl } for pid=50957 comm="iptables" path="/var/lib/containers/storage/ov erlay/f34481cd19d57e8184fc2b8ea06d5e775760bd8d5f496b352af6495014b62ad0/merg ed" dev="overlay" ino=3408018 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6795693] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:05:01 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795693/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795693/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aa400fcfa9ee4595b13bb081068463fa Command failed (workunit test cephadm/test_repos.sh) on smithi143 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2194423fe78ea1121b8a233f4f8fc979c1532a43 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [6795706] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:11:10 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795706/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795706/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cbd9ae59004f4d6c8ea169d85932ad37 Command failed on smithi152 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f896cba8-bf80-11ec-8c38-001a4aab830c -- ceph orch daemon add osd smithi152:vg_nvme/lv_4' [6795720] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw 3-final} ----------------------------------------------------------------- time: 00:23:09 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795720/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795720/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dae6b154810144979a9eef487b8bbd47 reached maximum tries (180) after waiting for 180 seconds [6795731] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:20:15 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795731/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795731/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6a0efc8ad8714455998b0fc483be0745 Command failed on smithi093 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 669b716a-bf83-11ec-8c38-001a4aab830c -e sha1=2194423fe78ea1121b8a233f4f8fc979c1532a43 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6795743] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:05:09 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795743/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795743/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a18b8b151c42450492f82ce899b150dc Command failed (workunit test cephadm/test_repos.sh) on smithi036 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2194423fe78ea1121b8a233f4f8fc979c1532a43 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [6795751] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795751/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795751/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a0b128b9feba47b8a2bb9751e8f5a30e Command failed on smithi158 with status 100: 'sudo apt-get clean' [6795759] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:05:18 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795759/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795759/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1106bafe7f5842799b6d75731d4fc719 [Errno 2] Cannot find file on the remote 'ubuntu@smithi081.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6795785] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:18:36 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795785/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795785/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c30d0e01b92347e986181709f71a5390 Command failed on smithi120 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 107e7fd6-bf86-11ec-8c38-001a4aab830c -e sha1=2194423fe78ea1121b8a233f4f8fc979c1532a43 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6795829] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:04:56 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795829/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795829/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e83b187e7c224c239b79724c5c7da67a Command failed (workunit test cephadm/test_repos.sh) on smithi125 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2194423fe78ea1121b8a233f4f8fc979c1532a43 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' [6795889] orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-add} ----------------------------------------------------------------- time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795889/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795889/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c087fc62acfa48e6a21484b590ab3813 Command failed on smithi035 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:2194423fe78ea1121b8a233f4f8fc979c1532a43 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 57689298-bf8f-11ec-8c38-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nceph orch daemon add osd $HOST:$DEV\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [6795895] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:13:50 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795895/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795895/ SELinux denials found on ubuntu@smithi007.front.sepia.ceph.com: ['type=AVC msg=audit(1650338899.819:7627): avc: denied { ioctl } for pid=50894 comm="iptables" path="/var/lib/containers/storage/overlay/7c834d31fc57402d9 fd3eb9a37c5b987eaa9eea8e303f07070a3e80d16462965/merged" dev="overlay" ino=3408018 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [6795901] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:19:52 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795901/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795901/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14a134a7b4b641b8a9b31c438aa7624f Command failed on smithi146 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 6629a2ee- bf90-11ec-8c38-001a4aab830c -e sha1=2194423fe78ea1121b8a233f4f8fc979c1532a43 -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [6795911] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:04:49 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795911/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795911/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9fa6c2bdfaab4393a07829ce5de4c845 Command failed (workunit test cephadm/test_repos.sh) on smithi116 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=2194423fe78ea1121b8a233f4f8fc979c1532a43 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_repos.sh' Pass ================================================================= [6795657] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:16:05 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795657/ [6795658] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:23:41 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795658/ [6795659] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:50:34 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795659/ [6795660] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:31 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795660/ [6795661] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:13:32 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795661/ [6795662] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:08 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795662/ [6795663] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:31:49 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795663/ [6795664] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:20:43 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795664/ [6795665] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:12:04 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795665/ [6795666] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:17:54 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795666/ [6795667] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:52 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795667/ [6795668] orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:22:19 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795668/ [6795669] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:14 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795669/ [6795671] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr orchestrator_cli} time: 00:22:57 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795671/ [6795672] orch/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:22:16 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795672/ [6795673] orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:14:34 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795673/ [6795674] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:13:45 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795674/ [6795675] orch/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:10:39 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795675/ [6795676] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:29:32 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795676/ [6795677] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:30:42 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795677/ [6795678] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:45:45 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795678/ [6795679] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:11:13 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795679/ [6795680] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:41:07 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795680/ [6795681] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:12 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795681/ [6795682] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:19:26 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795682/ [6795684] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/radosbench} time: 01:28:17 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795684/ [6795685] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:49 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795685/ [6795686] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:19 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795686/ [6795687] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:16:48 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795687/ [6795688] orch/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} time: 00:16:34 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795688/ [6795689] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:37:20 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795689/ [6795690] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:33:02 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795690/ [6795691] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:17:58 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795691/ [6795692] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:18:02 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795692/ [6795694] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:32:51 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795694/ [6795695] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:51 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795695/ [6795696] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:24:41 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795696/ [6795697] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:20:03 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795697/ [6795698] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:06 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795698/ [6795699] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:20:07 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795699/ [6795700] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:25:09 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795700/ [6795701] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:26:58 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795701/ [6795702] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:13:46 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795702/ [6795703] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:35:32 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795703/ [6795704] orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:39:32 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795704/ [6795705] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:43:52 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795705/ [6795707] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:21:05 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795707/ [6795708] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:18:10 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795708/ [6795709] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:11:56 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795709/ [6795710] orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:45 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795710/ [6795711] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:21:37 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795711/ [6795712] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:20:43 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795712/ [6795713] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:31 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795713/ [6795714] orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795714/ [6795715] orch/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/rgw 3-final} time: 00:14:04 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795715/ [6795716] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:47:30 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795716/ [6795717] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:30:37 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795717/ [6795718] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:41 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795718/ [6795719] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:10:03 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795719/ [6795721] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:41:44 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795721/ [6795722] orch/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:14 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795722/ [6795723] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:17:50 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795723/ [6795725] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:13:42 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795725/ [6795727] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:13:54 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795727/ [6795729] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:01 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795729/ [6795733] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:11:21 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795733/ [6795735] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:28:45 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795735/ [6795737] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:32:15 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795737/ [6795739] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:27:27 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795739/ [6795741] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795741/ [6795745] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:16:41 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795745/ [6795747] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:54 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795747/ [6795749] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:28:38 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795749/ [6795753] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:28:12 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795753/ [6795755] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:16:45 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795755/ [6795757] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:51 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795757/ [6795761] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:23:22 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795761/ [6795763] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:34:59 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795763/ [6795765] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:34:48 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795765/ [6795767] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:15:28 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795767/ [6795769] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:14 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795769/ [6795771] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:44:49 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795771/ [6795773] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:18:17 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795773/ [6795775] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:11:32 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795775/ [6795777] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:14 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795777/ [6795779] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:16:48 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795779/ [6795781] orch/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:20:26 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795781/ [6795783] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:05 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795783/ [6795787] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_18.04} 2-node-mgr orchestrator_cli} time: 00:09:32 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795787/ [6795789] orch/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:21:48 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795789/ [6795791] orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:13:04 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795791/ [6795793] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:14:09 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795793/ [6795795] orch/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:13:17 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795795/ [6795797] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:33:08 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795797/ [6795799] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:24:13 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795799/ [6795801] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:43:51 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795801/ [6795803] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:09:01 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795803/ [6795805] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:26:50 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795805/ [6795807] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:20:04 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795807/ [6795809] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:40 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795809/ [6795811] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:17:38 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795811/ [6795813] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:13:50 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795813/ [6795815] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:30:08 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795815/ [6795817] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:36 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795817/ [6795819] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:14:21 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795819/ [6795821] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:46:23 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795821/ [6795823] orch/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:24:10 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795823/ [6795825] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:16:24 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795825/ [6795827] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:13:42 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795827/ [6795831] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:23:15 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795831/ [6795833] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:21:00 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795833/ [6795835] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:05 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795835/ [6795837] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:17 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795837/ [6795839] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:20:03 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795839/ [6795841] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:16:47 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795841/ [6795843] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:23:27 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795843/ [6795845] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:27:28 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795845/ [6795847] orch/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:25:07 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795847/ [6795849] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:13:06 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795849/ [6795851] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:29:22 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795851/ [6795853] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:38:05 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795853/ [6795855] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:02 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795855/ [6795857] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:13:52 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795857/ [6795859] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:18:34 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795859/ [6795861] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:15:01 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795861/ [6795863] orch/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.6.2} time: 00:27:39 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795863/ [6795865] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:12:00 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795865/ [6795867] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:45:02 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795867/ [6795869] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:24 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795869/ [6795871] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:40 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795871/ [6795873] orch/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:12:46 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795873/ [6795875] orch/cephadm/smoke-singlehost/{0-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:14:27 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795875/ [6795877] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:34:35 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795877/ [6795879] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:28:17 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795879/ [6795881] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:21:07 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795881/ [6795883] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:08:59 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795883/ [6795885] orch/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:13:52 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795885/ [6795887] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:26:06 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795887/ [6795891] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:17:15 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795891/ [6795893] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:15:03 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795893/ [6795897] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:01 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795897/ [6795899] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/cache-snaps} time: 00:29:33 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795899/ [6795903] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:12:56 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795903/ [6795905] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:32:11 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795905/ [6795907] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:44:12 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795907/ [6795909] orch/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:16:02 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795909/ [6795913] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:58 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795913/ [6795915] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:17:02 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795915/ [6795917] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:26:54 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795917/ [6795919] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:23:57 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795919/ [6795921] orch/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:42:03 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795921/ [6795923] orch/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:16:54 info: http://pulpito.ceph.com/yuriw-2022-04-19_01:16:38-orch-wip-yuri4-testing-2022-04-18-1425-pacific-distro-default-smithi/6795923/