2023-08-24T01:05:13.673 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-24T01:05:13.675 INFO:teuthology.results:subset: '1/14' 2023-08-24T01:05:13.675 INFO:teuthology.results:seed: '798' 2023-08-24T02:02:35.486 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-24T02:02:35.518 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-08-24T13:16:24.612 INFO:teuthology.results:Tests finished! gathering results... 2023-08-24T13:16:32.812 INFO:scrape:Found 96 jobs 2023-08-24T13:16:34.254 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378042/teuthology.log 2023-08-24T13:16:34.256 INFO:scrape:Found 4 distinct failure reasons 2023-08-24T13:16:34.256 INFO:scrape:Failure: Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) 2023-08-24T13:16:34.257 INFO:scrape:2 jobs: ['7378046', '7378111'] 2023-08-24T13:16:34.257 INFO:scrape:suites intersection: ['agent/on', 'mon_election/connectivity', 'task/test_nfs}'] 2023-08-24T13:16:34.257 INFO:scrape:suites union: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_nfs}'] 2023-08-24T13:16:34.257 INFO:scrape: 2023-08-24T13:16:34.258 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds 2023-08-24T13:16:34.258 INFO:scrape:1 jobs: ['7378085'] 2023-08-24T13:16:34.258 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools'] 2023-08-24T13:16:34.259 INFO:scrape: 2023-08-24T13:16:34.259 INFO:scrape:Dead: b'2023-08-24T13:12:45.880 DEBUG:teuthology.exit:Finished running handlers' 2023-08-24T13:16:34.259 INFO:scrape:1 jobs: ['7378032'] 2023-08-24T13:16:34.259 INFO:scrape:suites: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2023-08-24T13:16:34.260 INFO:scrape: 2023-08-24T13:16:34.260 INFO:scrape:Dead: None 2023-08-24T13:16:34.260 INFO:scrape:2 jobs: ['7378042', '7378118'] 2023-08-24T13:16:34.261 INFO:scrape: 2023-08-24T13:16:34.265 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/ failed: 3 dead: 3 running: 0 waiting: 0 queued: 0 passed: 90 Fail ================================================================= [7378046] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:18:38 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378046/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378046/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5e6965e6a293492e84d59f2ff2b373d9 Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [7378085] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:31:02 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378085/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378085/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b71ecba4cc2f45c08d4cc4d080cb3da8 reached maximum tries (301) after waiting for 300 seconds [7378111] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:15:21 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378111/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378111/ sentry: https://sentry.ceph.com/organizations/ceph/?query=83087bdb200e43cda76e7edd3d25101e Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) Dead ================================================================= [7378032] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378032/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378032/ hit max job timeout [7378042] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_monitoring_stack_basic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378042/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378042/ Error reimaging machines: Timeout opening channel. [7378118] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378118/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378118/ Error reimaging machines: reached maximum tries (101) after waiting for 600 seconds Pass ================================================================= [7378028] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:20:41 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378028/ [7378029] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:17 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378029/ [7378030] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:44 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378030/ [7378031] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:19:01 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378031/ [7378033] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} time: 00:19:34 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378033/ [7378034] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:36:55 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378034/ [7378035] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:15:57 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378035/ [7378036] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:17 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378036/ [7378037] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:48 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378037/ [7378038] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:26:41 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378038/ [7378039] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:12 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378039/ [7378040] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:22:50 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378040/ [7378041] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:13:59 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378041/ [7378043] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} time: 00:38:16 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378043/ [7378044] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:17:42 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378044/ [7378045] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:41:34 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378045/ [7378047] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:08 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378047/ [7378048] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:18:23 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378048/ [7378049] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:16:21 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378049/ [7378050] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:32:45 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378050/ [7378051] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:37:54 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378051/ [7378052] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli} time: 00:16:34 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378052/ [7378053] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:20:05 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378053/ [7378054] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:31 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378054/ [7378055] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:18:01 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378055/ [7378056] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:24:19 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378056/ [7378057] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:23:32 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378057/ [7378058] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:53 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378058/ [7378059] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:38 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378059/ [7378060] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:59 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378060/ [7378061] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:20:02 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378061/ [7378062] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:38:37 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378062/ [7378063] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_rgw_multisite} time: 00:23:05 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378063/ [7378064] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:17:24 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378064/ [7378065] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:47:18 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378065/ [7378066] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:32:58 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378066/ [7378067] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:24:34 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378067/ [7378068] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:17:00 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378068/ [7378069] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:33:09 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378069/ [7378070] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:23 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378070/ [7378071] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:25 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378071/ [7378072] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:19:28 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378072/ [7378073] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:44:12 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378073/ [7378074] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:44:23 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378074/ [7378075] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_adoption} time: 00:10:33 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378075/ [7378076] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:18:39 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378076/ [7378077] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:15:48 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378077/ [7378078] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:32:00 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378078/ [7378079] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:19:52 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378079/ [7378080] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/on orchestrator_cli} time: 00:23:15 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378080/ [7378081] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:13:33 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378081/ [7378082] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:19 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378082/ [7378083] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:54:17 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378083/ [7378084] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_cephadm} time: 00:18:22 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378084/ [7378086] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:37:59 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378086/ [7378087] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:09 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378087/ [7378088] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:34 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378088/ [7378089] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:25:57 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378089/ [7378090] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:53 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378090/ [7378091] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:44 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378091/ [7378092] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:14:04 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378092/ [7378093] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:21:58 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378093/ [7378094] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:44:29 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378094/ [7378095] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:38:01 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378095/ [7378096] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_extra_daemon_features} time: 00:22:46 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378096/ [7378097] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:20:27 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378097/ [7378098] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:53 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378098/ [7378099] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:21:41 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378099/ [7378100] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:18:15 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378100/ [7378101] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:21:43 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378101/ [7378102] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:29:07 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378102/ [7378103] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:38 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378103/ [7378104] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:33 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378104/ [7378105] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:43 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378105/ [7378106] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:38:09 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378106/ [7378107] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:29:16 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378107/ [7378108] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:23:14 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378108/ [7378109] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:31:52 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378109/ [7378110] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:22 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378110/ [7378112] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:58 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378112/ [7378113] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:50 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378113/ [7378114] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:21:57 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378114/ [7378115] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:35:08 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378115/ [7378116] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:44:10 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378116/ [7378117] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:21:52 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378117/ [7378119] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:17 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378119/ [7378120] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:18:50 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378120/ [7378121] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:30:33 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378121/ [7378122] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:23:11 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378122/ [7378123] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:43 info: http://pulpito.ceph.com/adking-2023-08-24_00:26:12-orch:cephadm-wip-adk-testing-2023-08-23-1523-distro-default-smithi/7378123/