2022-08-13T16:51:28.396 INFO:root:teuthology version: 1.1.1.dev409+g9e7483cc 2022-08-13T16:51:28.398 INFO:teuthology.results:subset: '1/6' 2022-08-13T16:51:28.398 INFO:teuthology.results:seed: '2285' 2022-08-13T18:41:17.740 INFO:root:teuthology version: 1.1.1.dev409+g9e7483cc 2022-08-13T18:41:17.770 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-08-13T19:37:22.445 INFO:teuthology.results:Tests finished! gathering results... 2022-08-13T19:37:28.183 INFO:scrape:Found 96 jobs 2022-08-13T19:37:29.280 INFO:scrape:Found 2 distinct failure reasons 2022-08-13T19:37:29.281 INFO:scrape:Failure: Command failed on smithi111 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c2740c2-1b35-11ed-8431-001a4aab830c -- bash -c 'ceph nfs export ls foo --detailed'" 2022-08-13T19:37:29.281 INFO:scrape:3 jobs: ['6970502', '6970434', '6970469'] 2022-08-13T19:37:29.282 INFO:scrape:suites intersection: ['1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2022-08-13T19:37:29.282 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-bootstrap/octopus', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2022-08-13T19:37:29.283 INFO:scrape: 2022-08-13T19:37:29.283 INFO:scrape:Failure: Test failure: test_cluster_reset_user_config_with_non_existing_clusterid (tasks.cephfs.test_nfs.TestNFS) 2022-08-13T19:37:29.283 INFO:scrape:1 jobs: ['6970463'] 2022-08-13T19:37:29.284 INFO:scrape:suites: ['mon_election/connectivity', 'orch:cephadm/workunits/{agent/off', 'task/test_nfs}'] 2022-08-13T19:37:29.284 INFO:scrape: 2022-08-13T19:37:29.287 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 92 Fail ================================================================= [6970434] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:37:38 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970434/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970434/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7825d07260734074822fa1efb87b6ec0 Command failed on smithi007 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 62337b10-1b2a-11ed-8431-001a4aab830c -- bash -c 'ceph nfs export ls foo --detailed'" [6970463] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:17:10 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970463/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970463/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58b07e1bcae649eeb40b822f20acfe82 Test failure: test_cluster_reset_user_config_with_non_existing_clusterid (tasks.cephfs.test_nfs.TestNFS) [6970469] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:33:07 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970469/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970469/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8b7fd4c162d540c9a584d2c7747fa038 Command failed on smithi130 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 4b8c9206-1b30-11ed-8431-001a4aab830c -- bash -c 'ceph nfs export ls foo --detailed'" [6970502] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:36:44 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970502/ log: http://qa-proxy.ceph.com/teuthology/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970502/ sentry: https://sentry.ceph.com/organizations/ceph/?query=827e1014211348e3ab006e063e7e5c13 Command failed on smithi111 with status 22: "sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v15 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 8c2740c2-1b35-11ed-8431-001a4aab830c -- bash -c 'ceph nfs export ls foo --detailed'" Pass ================================================================= [6970432] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:10 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970432/ [6970433] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:34 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970433/ [6970435] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} time: 00:18:38 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970435/ [6970436] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:33:56 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970436/ [6970437] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:13:37 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970437/ [6970438] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:32:37 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970438/ [6970439] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:35:27 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970439/ [6970440] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:37:15 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970440/ [6970441] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:05:40 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970441/ [6970442] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:33 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970442/ [6970443] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:38 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970443/ [6970444] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:36 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970444/ [6970445] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:47 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970445/ [6970446] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:07 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970446/ [6970447] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:38:11 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970447/ [6970448] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:40:19 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970448/ [6970449] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:24:48 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970449/ [6970450] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:12 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970450/ [6970451] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:46:24 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970451/ [6970452] orch:cephadm/workunits/{agent/on mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:15:13 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970452/ [6970453] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:26:47 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970453/ [6970454] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:20 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970454/ [6970455] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:11 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970455/ [6970456] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:26 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970456/ [6970457] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:14:20 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970457/ [6970458] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:39:29 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970458/ [6970459] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:49:01 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970459/ [6970460] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:16:59 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970460/ [6970461] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:35:16 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970461/ [6970462] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:24:25 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970462/ [6970464] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:16:31 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970464/ [6970465] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:52:24 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970465/ [6970466] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:36:42 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970466/ [6970467] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:33:40 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970467/ [6970468] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:31 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970468/ [6970470] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:18:50 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970470/ [6970471] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:26:28 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970471/ [6970472] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:58 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970472/ [6970473] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:57:14 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970473/ [6970474] orch:cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} time: 00:18:40 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970474/ [6970475] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:15:12 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970475/ [6970476] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:45:11 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970476/ [6970477] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:38:56 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970477/ [6970478] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:16:30 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970478/ [6970479] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:09 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970479/ [6970480] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:32:32 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970480/ [6970481] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:53 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970481/ [6970482] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:40 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970482/ [6970483] orch:cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} time: 00:12:44 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970483/ [6970484] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:32 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970484/ [6970485] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:16:15 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970485/ [6970486] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:37:41 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970486/ [6970487] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:46:38 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970487/ [6970488] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:36:36 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970488/ [6970489] orch:cephadm/workunits/{agent/on mon_election/classic task/test_adoption} time: 00:08:45 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970489/ [6970490] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:19:51 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970490/ [6970491] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:24:04 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970491/ [6970492] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:32 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970492/ [6970493] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:22:34 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970493/ [6970494] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:36:16 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970494/ [6970495] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:39:57 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970495/ [6970496] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:14:53 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970496/ [6970497] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:35:35 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970497/ [6970498] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} time: 00:18:09 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970498/ [6970499] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:33 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970499/ [6970500] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:26:38 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970500/ [6970501] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:14:52 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970501/ [6970503] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:44 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970503/ [6970504] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:37 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970504/ [6970505] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:52:48 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970505/ [6970506] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:43:03 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970506/ [6970507] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:21:01 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970507/ [6970508] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:54:55 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970508/ [6970509] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:24:46 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970509/ [6970510] orch:cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:05:34 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970510/ [6970511] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:52 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970511/ [6970512] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:08 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970512/ [6970513] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:49 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970513/ [6970514] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:49 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970514/ [6970515] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:33:36 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970515/ [6970516] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:36:23 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970516/ [6970517] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:54 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970517/ [6970518] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:27:06 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970518/ [6970519] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:17 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970519/ [6970520] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:27:43 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970520/ [6970521] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:15:25 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970521/ [6970522] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:15:16 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970522/ [6970523] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:50:31 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970523/ [6970524] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:38:43 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970524/ [6970525] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:17:26 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970525/ [6970526] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:18:18 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970526/ [6970527] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:16 info: http://pulpito.ceph.com/adking-2022-08-12_20:56:57-orch:cephadm-wip-adk-testing-2022-08-12-1411-distro-default-smithi/6970527/