2023-03-02T08:25:29.063 INFO:root:teuthology version: 0.0.1.dev49+gc7c3cc8 2023-03-02T08:25:29.064 INFO:teuthology.results:subset: '1/13' 2023-03-02T08:25:29.064 INFO:teuthology.results:seed: '2812' 2023-03-02T09:28:06.607 INFO:root:teuthology version: 0.0.1.dev49+gc7c3cc8 2023-03-02T09:28:06.634 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-03-02T10:31:12.037 INFO:teuthology.results:Tests finished! gathering results... 2023-03-02T10:31:17.902 INFO:scrape:Found 87 jobs 2023-03-02T10:31:18.125 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190850/teuthology.log 2023-03-02T10:31:18.126 INFO:scrape:Found 2 distinct failure reasons 2023-03-02T10:31:18.127 INFO:scrape:Failure: Command failed on smithi159 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:cac2e2e38fd826ed75695a025c7fcf73b3bcdb17 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ee6c9b74-b8d8-11ed-9ae9-001a4aab830c -- ceph mon dump -f json' 2023-03-02T10:31:18.127 INFO:scrape:1 jobs: ['7190843'] 2023-03-02T10:31:18.127 INFO:scrape:suites: ['1-start', '2-thrash', '3-tasks/rados_api_tests', 'fixed-2', 'msgr/async-v1only', 'orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0', 'root}'] 2023-03-02T10:31:18.128 INFO:scrape: 2023-03-02T10:31:18.128 INFO:scrape:Dead: None 2023-03-02T10:31:18.128 INFO:scrape:1 jobs: ['7190850'] 2023-03-02T10:31:18.129 INFO:scrape: 2023-03-02T10:31:18.133 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/ failed: 1 dead: 1 running: 0 waiting: 0 queued: 0 passed: 85 Fail ================================================================= [7190843] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:16:21 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190843/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190843/ sentry: https://sentry.ceph.com/organizations/ceph/?query=031293b8e68c45cfa5969b20b7606f67 Command failed on smithi159 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:cac2e2e38fd826ed75695a025c7fcf73b3bcdb17 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ee6c9b74-b8d8-11ed-9ae9-001a4aab830c -- ceph mon dump -f json' Dead ================================================================= [7190850] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190850/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190850/ Error reimaging machines: 'NoneType' object has no attribute '_fields' Pass ================================================================= [7190810] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:53:48 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190810/ [7190811] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:33:40 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190811/ [7190812] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:21:48 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190812/ [7190813] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:05:41 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190813/ [7190814] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_nfs} time: 00:37:40 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190814/ [7190815] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:34:21 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190815/ [7190816] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/off orchestrator_cli} time: 00:17:19 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190816/ [7190817] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:45:05 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190817/ [7190818] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:15:17 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190818/ [7190819] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} time: 00:37:10 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190819/ [7190820] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:24:28 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190820/ [7190821] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:38 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190821/ [7190822] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:41 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190822/ [7190823] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:17:43 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190823/ [7190824] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:34:01 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190824/ [7190825] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:36:09 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190825/ [7190826] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:40:23 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190826/ [7190827] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} time: 00:17:52 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190827/ [7190828] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:13 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190828/ [7190829] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:04 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190829/ [7190830] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:26:10 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190830/ [7190831] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:25 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190831/ [7190832] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:26:42 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190832/ [7190833] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:21:45 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190833/ [7190834] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:40:01 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190834/ [7190835] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:29:37 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190835/ [7190836] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:47:24 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190836/ [7190837] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:30:08 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190837/ [7190838] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:19:29 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190838/ [7190839] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:15 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190839/ [7190840] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:39 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190840/ [7190841] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:27 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190841/ [7190842] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:20:23 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190842/ [7190844] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:39:51 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190844/ [7190845] orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_adoption} time: 00:14:42 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190845/ [7190846] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:32:10 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190846/ [7190847] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:17:25 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190847/ [7190848] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:34:21 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190848/ [7190849] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:32:31 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190849/ [7190851] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:53:59 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190851/ [7190852] orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm} time: 00:20:20 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190852/ [7190853] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:20:24 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190853/ [7190854] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:20 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190854/ [7190855] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:26:46 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190855/ [7190856] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:33 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190856/ [7190857] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:04 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190857/ [7190858] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:57:37 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190858/ [7190859] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} time: 00:16:53 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190859/ [7190860] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:16:34 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190860/ [7190861] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:54 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190861/ [7190862] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:45:10 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190862/ [7190863] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:39:08 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190863/ [7190864] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm_repos} time: 00:06:47 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190864/ [7190865] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:37 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190865/ [7190866] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:13 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190866/ [7190867] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:22:44 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190867/ [7190868] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:27:29 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190868/ [7190869] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:02 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190869/ [7190870] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:20:04 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190870/ [7190871] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:40:33 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190871/ [7190872] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:45:57 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190872/ [7190873] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_nfs} time: 00:31:25 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190873/ [7190874] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:29:23 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190874/ [7190875] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:37:02 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190875/ [7190876] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:43 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190876/ [7190877] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:17:26 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190877/ [7190878] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:23 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190878/ [7190879] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:00 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190879/ [7190880] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:38:40 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190880/ [7190881] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:20 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190881/ [7190882] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli} time: 00:17:44 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190882/ [7190883] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:33:25 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190883/ [7190884] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:33 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190884/ [7190885] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:47 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190885/ [7190886] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:36 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190886/ [7190887] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:18:44 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190887/ [7190888] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:27:32 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190888/ [7190889] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:26:56 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190889/ [7190890] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:54:36 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190890/ [7190891] orch:cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:32:39 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190891/ [7190892] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:27:02 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190892/ [7190893] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:37 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190893/ [7190894] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:53:54 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190894/ [7190895] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:19 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190895/ [7190896] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:29 info: http://pulpito.ceph.com/adking-2023-03-01_21:49:44-orch:cephadm-wip-adk3-testing-2023-03-01-1415-quincy-distro-default-smithi/7190896/