2023-09-30T16:58:51.925 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T16:58:51.925 INFO:teuthology.results:subset: '1/14' 2023-09-30T16:58:51.925 INFO:teuthology.results:seed: '7358' 2023-09-30T18:27:54.716 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T18:27:54.748 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-09-30T19:14:58.647 INFO:teuthology.results:Tests finished! gathering results... 2023-09-30T19:15:03.715 INFO:scrape:Found 95 jobs 2023-09-30T19:15:04.504 INFO:scrape:Found 3 distinct failure reasons 2023-09-30T19:15:04.505 INFO:scrape:Failure: Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) 2023-09-30T19:15:04.505 INFO:scrape:1 jobs: ['7405494'] 2023-09-30T19:15:04.505 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'cluster/{1-node}', 'objectstore/bluestore-bitmap', 'orch:cephadm/nfs/{begin/{0-install', 'overrides/ignorelist_health', 'supported-random-distros$/{ubuntu_20.04}', 'tasks/nfs}'] 2023-09-30T19:15:04.505 INFO:scrape: 2023-09-30T19:15:04.505 INFO:scrape:Failure: Command failed on smithi008 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c738a938-5fb5-11ee-8db5-212e2dc638e7 -e sha1=f78c4ba7cbda85af43312ce1996d6ff0f8f96f8a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' 2023-09-30T19:15:04.505 INFO:scrape:1 jobs: ['7405493'] 2023-09-30T19:15:04.505 INFO:scrape:suites: ['1-bootstrap/17.2.0', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2023-09-30T19:15:04.505 INFO:scrape: 2023-09-30T19:15:04.506 INFO:scrape:Failure: reached maximum tries (301) after waiting for 300 seconds 2023-09-30T19:15:04.506 INFO:scrape:1 jobs: ['7405547'] 2023-09-30T19:15:04.506 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/jaeger', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools'] 2023-09-30T19:15:04.506 INFO:scrape: 2023-09-30T19:15:04.509 INFO:teuthology.results:Sending results to adking@redhat.com: Test Run: adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/ failed: 3 dead: 0 running: 0 waiting: 0 queued: 0 passed: 92 Fail ================================================================= [7405493] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/17.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:32:11 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405493/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405493/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a0d7b5c337b4706a80c7d1b85edf1fc Command failed on smithi008 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c738a938-5fb5-11ee-8db5-212e2dc638e7 -e sha1=f78c4ba7cbda85af43312ce1996d6ff0f8f96f8a -- bash -c \'ceph versions | jq -e \'"\'"\'.overall | length == 1\'"\'"\'\'' [7405494] orch:cephadm/nfs/{begin/{0-install 1-ceph 2-logrotate} cluster/{1-node} objectstore/bluestore-bitmap overrides/ignorelist_health supported-random-distros$/{ubuntu_20.04} tasks/nfs} ----------------------------------------------------------------- time: 00:16:21 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405494/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405494/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4ecd118d00e847b897b65563d20946bf Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [7405547] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:28:15 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405547/ log: http://qa-proxy.ceph.com/teuthology/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405547/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2f13d24317454dbb99b901b83399c09e reached maximum tries (301) after waiting for 300 seconds Pass ================================================================= [7405489] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_extra_daemon_features} time: 00:17:05 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405489/ [7405490] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:43 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405490/ [7405491] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:02 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405491/ [7405492] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:17 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405492/ [7405495] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} time: 00:21:03 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405495/ [7405496] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} time: 00:37:15 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405496/ [7405497] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:15:54 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405497/ [7405498] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:14:33 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405498/ [7405499] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:50 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405499/ [7405500] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:27:10 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405500/ [7405501] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:25 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405501/ [7405502] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:30:12 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405502/ [7405503] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:23:42 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405503/ [7405504] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:03:44 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405504/ [7405505] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_monitoring_stack_basic} time: 00:26:06 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405505/ [7405506] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rotate-keys} time: 00:37:44 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405506/ [7405507] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:17:43 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405507/ [7405508] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:41:46 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405508/ [7405509] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:19:34 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405509/ [7405510] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:36 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405510/ [7405511] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:15:12 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405511/ [7405512] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_orch_cli} time: 00:19:25 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405512/ [7405513] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:32:42 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405513/ [7405514] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:39:05 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405514/ [7405515] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:19:05 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405515/ [7405516] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:37:42 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405516/ [7405517] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:33:19 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405517/ [7405518] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:37 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405518/ [7405519] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:23:11 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405519/ [7405520] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:29 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405520/ [7405521] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:07 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405521/ [7405522] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:18 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405522/ [7405523] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:20:09 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405523/ [7405524] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_rgw_multisite} time: 00:18:17 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405524/ [7405525] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:36:41 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405525/ [7405526] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:16:49 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405526/ [7405527] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:46:21 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405527/ [7405528] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:31:22 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405528/ [7405529] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:20:12 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405529/ [7405530] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:36 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405530/ [7405531] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:36 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405531/ [7405532] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:31 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405532/ [7405533] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:39 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405533/ [7405534] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:18:33 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405534/ [7405535] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:42:50 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405535/ [7405536] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:33 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405536/ [7405537] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_adoption} time: 00:17:45 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405537/ [7405538] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:18:04 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405538/ [7405539] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:19:33 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405539/ [7405540] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:31:39 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405540/ [7405541] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:19:07 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405541/ [7405542] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/on orchestrator_cli} time: 00:16:43 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405542/ [7405543] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:17:30 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405543/ [7405544] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:19 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405544/ [7405545] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:50:03 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405545/ [7405546] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_cephadm} time: 00:18:37 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405546/ [7405548] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:37:06 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405548/ [7405549] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:53 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405549/ [7405550] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:57 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405550/ [7405551] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:26:16 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405551/ [7405552] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:25 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405552/ [7405553] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:31 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405553/ [7405554] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:09:28 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405554/ [7405555] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:19:40 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405555/ [7405556] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:42:58 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405556/ [7405557] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:38:47 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405557/ [7405558] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_extra_daemon_features} time: 00:18:15 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405558/ [7405559] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:18:20 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405559/ [7405560] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:26 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405560/ [7405561] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:19:25 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405561/ [7405562] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:21:32 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405562/ [7405563] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:27:47 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405563/ [7405564] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:20:33 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405564/ [7405565] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:33:38 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405565/ [7405566] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:18:03 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405566/ [7405567] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:14:24 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405567/ [7405568] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:38:05 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405568/ [7405569] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:28:03 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405569/ [7405570] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_monitoring_stack_basic} time: 00:26:36 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405570/ [7405571] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:30:22 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405571/ [7405572] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:02 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405572/ [7405573] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:38 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405573/ [7405574] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:37 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405574/ [7405575] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:20:42 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405575/ [7405576] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} time: 00:20:00 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405576/ [7405577] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:35:56 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405577/ [7405578] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:21 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405578/ [7405579] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:19:18 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405579/ [7405580] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:24:31 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405580/ [7405581] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:30 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405581/ [7405582] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:18:49 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405582/ [7405583] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:33 info: http://pulpito.ceph.com/adking-2023-09-28_12:35:23-orch:cephadm-wip-adk-testing-2023-09-27-2233-distro-default-smithi/7405583/