2022-03-21T06:02:09.635 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-21T06:02:09.637 INFO:teuthology.results:subset: '1/9' 2022-03-21T06:02:09.638 INFO:teuthology.results:seed: '2573' 2022-03-22T00:30:34.109 INFO:root:teuthology version: 1.1.0-a4e18662 2022-03-22T00:30:34.133 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-22T01:15:37.628 INFO:teuthology.results:Tests finished! gathering results... 2022-03-22T01:15:42.841 INFO:scrape:Found 80 jobs 2022-03-22T01:15:42.842 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749712/teuthology.log 2022-03-22T01:15:43.455 INFO:scrape:Found 4 distinct failure reasons 2022-03-22T01:15:43.456 INFO:scrape:Dead: None 2022-03-22T01:15:43.457 INFO:scrape:1 jobs: ['6749712'] 2022-03-22T01:15:43.457 INFO:scrape: 2022-03-22T01:15:43.458 INFO:scrape:Failure: Command failed on smithi136 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c \'echo "Check with $(hostname) ganesha(s) down..."\nfor c in `systemctl | grep ceph- | grep @nfs | awk \'"\'"\'{print $1}\'"\'"\'`; do\n cid=`echo $c | sed \'"\'"\'s/@/-/\'"\'"\'`\n id=`echo $c | cut -d @ -f 2 | sed \'"\'"\'s/.service$//\'"\'"\'`\n fsid=`echo $c | cut -d @ -f 1 | cut -d - -f 2-`\n echo "Removing daemon $id fsid $fsid..."\n sudo $TESTDIR/cephadm rm-daemon --fsid $fsid --name $id\n\n echo "Waking up cephadm..."\n sudo $TESTDIR/cephadm shell -- ceph orch ps --refresh\n\n while ! timeout 1 cat /mnt/foo/testfile ; do true ; done\n echo "Mount is back!"\ndone\n\'' 2022-03-22T01:15:43.458 INFO:scrape:1 jobs: ['6749676'] 2022-03-22T01:15:43.459 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress2', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04'] 2022-03-22T01:15:43.459 INFO:scrape: 2022-03-22T01:15:43.460 INFO:scrape:Failure: Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) 2022-03-22T01:15:43.460 INFO:scrape:1 jobs: ['6749700'] 2022-03-22T01:15:43.461 INFO:scrape:suites: ['mon_election/classic', 'orch:cephadm/workunits/{agent/off', 'task/test_nfs}'] 2022-03-22T01:15:43.461 INFO:scrape: 2022-03-22T01:15:43.462 INFO:scrape:Failure: Command failed on smithi093 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c '/home/ubuntu/cephtest/cephadm shell radosgw-admin user create --uid foouser --display-name foo > /tmp/user.json'" 2022-03-22T01:15:43.462 INFO:scrape:1 jobs: ['6749716'] 2022-03-22T01:15:43.462 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress-rgw-user', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04'] 2022-03-22T01:15:43.463 INFO:scrape: 2022-03-22T01:15:43.467 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/ failed: 3 dead: 1 running: 0 waiting: 0 queued: 0 passed: 76 Fail ================================================================= [6749676] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:16:33 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749676/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749676/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe7fa7b2ea244c4e91c8b9e3f15d0cb3 Command failed on smithi136 with status 1: 'sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c \'echo "Check with $(hostname) ganesha(s) down..."\nfor c in `systemctl | grep ceph- | grep @nfs | awk \'"\'"\'{print $1}\'"\'"\'`; do\n cid=`echo $c | sed \'"\'"\'s/@/-/\'"\'"\'`\n id=`echo $c | cut -d @ -f 2 | sed \'"\'"\'s/.service$//\'"\'"\'`\n fsid=`echo $c | cut -d @ -f 1 | cut -d - -f 2-`\n echo "Removing daemon $id fsid $fsid..."\n sudo $TESTDIR/cephadm rm-daemon --fsid $fsid --name $id\n\n echo "Waking up cephadm..."\n sudo $TESTDIR/cephadm shell -- ceph orch ps --refresh\n\n while ! timeout 1 cat /mnt/foo/testfile ; do true ; done\n echo "Mount is back!"\ndone\n\'' [6749700] orch:cephadm/workunits/{agent/off mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:13:18 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749700/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749700/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2809270b15d40b58582a2298d8a0f3f Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [6749716] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:14:32 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749716/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749716/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b5f3219d3d9a4be49d0be2a535fad5e8 Command failed on smithi093 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c '/home/ubuntu/cephtest/cephadm shell radosgw-admin user create --uid foouser --display-name foo > /tmp/user.json'" Dead ================================================================= [6749712] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749712/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749712/ Error reimaging machines: Failed to power on smithi114 Pass ================================================================= [6749675] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:31:32 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749675/ [6749677] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:46 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749677/ [6749678] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:30:24 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749678/ [6749679] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:31:39 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749679/ [6749680] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/off orchestrator_cli} time: 00:15:05 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749680/ [6749681] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:30:36 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749681/ [6749682] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:12:22 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749682/ [6749683] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/basic 3-final} time: 00:10:54 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749683/ [6749684] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:18 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749684/ [6749685] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:11:50 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749685/ [6749686] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:45:50 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749686/ [6749687] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:36:34 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749687/ [6749688] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:04:42 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749688/ [6749689] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:12 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749689/ [6749690] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:17:04 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749690/ [6749691] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:06 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749691/ [6749692] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:24:36 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749692/ [6749693] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:21:17 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749693/ [6749694] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:13:23 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749694/ [6749695] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:11:28 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749695/ [6749696] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:11 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749696/ [6749697] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:13:24 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749697/ [6749698] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:40:23 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749698/ [6749699] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:33:30 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749699/ [6749701] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:12:04 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749701/ [6749702] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:32:09 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749702/ [6749703] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:11:37 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749703/ [6749704] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:49 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749704/ [6749705] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:30:04 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749705/ [6749706] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:44 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749706/ [6749707] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:24:56 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749707/ [6749708] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:16:39 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749708/ [6749709] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:10 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749709/ [6749710] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:58:41 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749710/ [6749711] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:42:40 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749711/ [6749713] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:13:39 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749713/ [6749714] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:24:20 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749714/ [6749715] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:43 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749715/ [6749717] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:18 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749717/ [6749718] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} time: 00:23:24 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749718/ [6749719] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:37 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749719/ [6749720] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:14:34 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749720/ [6749721] orch:cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/rgw 3-final} time: 00:13:36 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749721/ [6749722] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:28:13 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749722/ [6749723] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:30:44 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749723/ [6749724] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:34:48 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749724/ [6749725] orch:cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:07:47 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749725/ [6749726] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:15:21 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749726/ [6749727] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:11:44 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749727/ [6749728] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:21:02 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749728/ [6749729] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:13:41 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749729/ [6749730] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:12:45 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749730/ [6749731] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:12:19 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749731/ [6749732] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:35:14 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749732/ [6749733] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:44:26 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749733/ [6749734] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} time: 00:15:13 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749734/ [6749735] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:33:13 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749735/ [6749736] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:14:04 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749736/ [6749737] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:20 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749737/ [6749738] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:24:09 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749738/ [6749739] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:18:36 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749739/ [6749740] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:30:14 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749740/ [6749741] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:13:42 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749741/ [6749742] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:58 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749742/ [6749743] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:14:56 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749743/ [6749744] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:10:42 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749744/ [6749745] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:44:05 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749745/ [6749746] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:37:11 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749746/ [6749747] orch:cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:04:40 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749747/ [6749748] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:13:42 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749748/ [6749749] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:11 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749749/ [6749750] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:30:35 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749750/ [6749751] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:21:29 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749751/ [6749752] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:12:50 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749752/ [6749753] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:12:29 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749753/ [6749754] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:36 info: http://pulpito.ceph.com/adking-2022-03-21_05:58:33-orch:cephadm-wip-adk-testing-2022-03-20-2156-distro-basic-smithi/6749754/