2023-03-14T23:24:35.041 INFO:root:teuthology version: 0.0.1.dev57+g5c9057f 2023-03-14T23:24:35.193 INFO:teuthology.results:subset: '111/120000' 2023-03-14T23:24:35.193 INFO:teuthology.results:seed: '3473' 2023-03-15T02:30:37.435 INFO:root:teuthology version: 0.0.1.dev57+g5c9057f 2023-03-15T02:30:37.464 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-03-15T03:31:42.993 INFO:teuthology.results:Tests finished! gathering results... 2023-03-15T03:31:52.308 INFO:scrape:Found 134 jobs 2023-03-15T03:31:54.576 INFO:scrape:Found 6 distinct failure reasons 2023-03-15T03:31:54.577 INFO:scrape:Failure: Command failed on smithi117 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' 2023-03-15T03:31:54.578 INFO:scrape:5 jobs: ['7207793', '7207643', '7207768', '7207728', '7207570'] 2023-03-15T03:31:54.579 INFO:scrape:suites intersection: [] 2023-03-15T03:31:54.579 INFO:scrape:suites union: ['0-kubeadm', '0-nvme-loop', '1-rook', '2-workload/none', '2-workload/radosbench', '3-final', 'agent/off', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'mon_election/classic', 'net/calico', 'net/flannel', 'net/host', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'orch/rook/smoke/{0-distro/ubuntu_20.04', 'rook/1.7.2}', 'rook/master}', 'task/test_orch_cli_mon}'] 2023-03-15T03:31:54.579 INFO:scrape: 2023-03-15T03:31:54.580 INFO:scrape:Failure: Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) 2023-03-15T03:31:54.580 INFO:scrape:2 jobs: ['7207734', '7207601'] 2023-03-15T03:31:54.580 INFO:scrape:suites intersection: ['agent/off', 'task/test_nfs}'] 2023-03-15T03:31:54.581 INFO:scrape:suites union: ['agent/off', 'mon_election/classic', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0', 'orch/cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_nfs}'] 2023-03-15T03:31:54.581 INFO:scrape: 2023-03-15T03:31:54.582 INFO:scrape:Failure: Command failed on smithi057 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0b3f02d8-c2d8-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_4' 2023-03-15T03:31:54.582 INFO:scrape:1 jobs: ['7207797'] 2023-03-15T03:31:54.583 INFO:scrape:suites: ['1-ranks/1', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific'] 2023-03-15T03:31:54.583 INFO:scrape: 2023-03-15T03:31:54.584 INFO:scrape:Failure: {'smithi067.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'module_stderr': "Warning: Permanently added 'smithi067.front.sepia.ceph.com,172.21.15.67' (ECDSA) to the list of known hosts.\r\nControlSocket /home/teuthworker/.ansible/cp/d3889381bc already exists, disabling multiplexing\r\nConnection to smithi067.front.sepia.ceph.com closed.\r\n", 'module_stdout': "/usr/libexec/platform-python: can't open file '/home/ubuntu/.ansible/tmp/ansible-tmp-1678844350.0219128-27596-115246843413767/AnsiballZ_dnf.py': [Errno 2] No such file or directory\r\n", 'msg': 'MODULE FAILURE\nSee stdout/stderr for the exact error', 'rc': 2}} 2023-03-15T03:31:54.584 INFO:scrape:1 jobs: ['7207724'] 2023-03-15T03:31:54.584 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs2', '3-final}', 'orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun'] 2023-03-15T03:31:54.585 INFO:scrape: 2023-03-15T03:31:54.585 INFO:scrape:Failure: {'smithi067.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': "Failed to connect to the host via ssh: Warning: Permanently added 'smithi067.front.sepia.ceph.com,172.21.15.67' (ECDSA) to the list of known hosts.\r\nubuntu@smithi067.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive)."}} 2023-03-15T03:31:54.585 INFO:scrape:2 jobs: ['7207758', '7207776'] 2023-03-15T03:31:54.586 INFO:scrape:suites intersection: ['1-start'] 2023-03-15T03:31:54.586 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/octopus', '1-start', '2-nfs', '2-services/mirror', '3-final}', '3-upgrade-with-workload', '4-final}', 'orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools', 'orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0'] 2023-03-15T03:31:54.587 INFO:scrape: 2023-03-15T03:31:54.587 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi005.front.sepia.ceph.com: ['type=AVC msg=audit(1678842912.958:19538): avc: denied { ioctl } for pid=121906 comm="iptables" path="/var/lib/containers/storage/overlay/47381bac29186c817bda12bc439210bde94512264ae5fc30e3670f0a1db899e7/merged" dev="overlay" ino=4067387 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] 2023-03-15T03:31:54.587 INFO:scrape:1 jobs: ['7207681'] 2023-03-15T03:31:54.588 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_cephadm}'] 2023-03-15T03:31:54.588 INFO:scrape: 2023-03-15T03:31:54.594 INFO:teuthology.results:Sending results to yweinstein@radhat.com: Test Run: yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/ failed: 10 dead: 2 running: 0 waiting: 0 queued: 0 passed: 122 Fail ================================================================= [7207570] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:06:21 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207570/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207570/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7843bf6e6bf74b918cf9410198598875 Command failed on smithi067 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7207601] orch/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:25:46 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207601/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207601/ sentry: https://sentry.ceph.com/organizations/ceph/?query=54226774570c4db1abacd1510858e0d2 Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) [7207643] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/flannel rook/1.7.2} ----------------------------------------------------------------- time: 00:06:40 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207643/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207643/ sentry: https://sentry.ceph.com/organizations/ceph/?query=49455c1716404f10b9cee7a60f0e0acf Command failed on smithi047 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7207681] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:18:31 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207681/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207681/ SELinux denials found on ubuntu@smithi005.front.sepia.ceph.com: ['type=AVC msg=audit(1678842912.958:19538): avc: denied { ioctl } for pid=121906 comm="iptables" path="/var/lib/containers/storage/overlay/47381bac29186c817 bda12bc439210bde94512264ae5fc30e3670f0a1db899e7/merged" dev="overlay" ino=4067387 scontext=system_u:system_r:iptables_t:s0 tcontext=system_u:object_r:container_file_t:s0:c1022,c1023 tclass=dir permissive=1'] [7207728] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/host rook/master} ----------------------------------------------------------------- time: 00:06:17 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207728/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207728/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0da13ac68f9d49bc86eff58b93e454e6 Command failed on smithi002 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7207734] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:26:50 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207734/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207734/ sentry: https://sentry.ceph.com/organizations/ceph/?query=32186ca3b4194f5380cab34b90077ada Test failure: test_non_existent_cluster (tasks.cephfs.test_nfs.TestNFS) [7207768] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli_mon} ----------------------------------------------------------------- time: 00:07:38 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207768/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207768/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b13f98973f5241df90aaf0aecaaad152 Command failed on smithi132 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7207776] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} ----------------------------------------------------------------- time: 00:06:52 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207776/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207776/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f142e01609f14ae69d382adbda8a7a57 {'smithi067.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': 'Failed to connect to the host via ssh: ssh: connect to host smithi067.front.sepia.ceph.com port 22: No route to host'}} [7207793] orch/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 0-nvme-loop 1-rook 2-workload/radosbench 3-final cluster/1-node k8s/1.21 net/calico rook/1.7.2} ----------------------------------------------------------------- time: 00:06:15 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207793/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207793/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3ddf867542454f8e9a8c6f381897ac87 Command failed on smithi117 with status 1: 'sudo systemctl enable --now kubelet && sudo kubeadm config images pull' [7207797] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:19:07 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207797/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207797/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79585eee0fde42a6b52b2be42a84c3a5 Command failed on smithi057 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest- pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0b3f02d8-c2d8-11ed-9afb-001a4aab830c -- ceph orch daemon add osd smithi057:vg_nvme/lv_4' Dead ================================================================= [7207724] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:15:47 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207724/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207724/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d027ce58a6a747948b2bfbf44247f71a {'smithi067.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': False, 'module_stderr': "Warning: Permanently added 'smithi067.front.sepia.ceph.com,172.21.15.67' (ECDSA) to the list of known hosts.\r\nControlSocket /home/teuthworker/.ansible/cp/d3889381bc already exists, disabling multiplexing\r\nConnection to smithi067.front.sepia.ceph.com closed.\r\n", 'module_stdout': "/usr/libexec/platform-python: can't open file '/home/ubuntu/.ansible/tmp/ansible- tmp-1678844350.0219128-27596-115246843413767/AnsiballZ_dnf.py': [Errno 2] No such file or directory\r\n", 'msg': 'MODULE FAILURE\nSee stdout/stderr for the exact error', 'rc': 2}} [7207758] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:07:14 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207758/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207758/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7f35dbda7b534af6a2b1e86502f09b4a {'smithi067.front.sepia.ceph.com': {'_ansible_no_log': False, 'msg': "Failed to connect to the host via ssh: Warning: Permanently added 'smithi067.front.sepia.ceph.com,172.21.15.67' (ECDSA) to the list of known hosts.\r\nubuntu@smithi067.front.sepia.ceph.com: Permission denied (publickey,password,keyboard-interactive)."}} Pass ================================================================= [7207556] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:31:45 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207556/ [7207558] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:15:52 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207558/ [7207560] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:36:39 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207560/ [7207562] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:28:42 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207562/ [7207564] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:24:48 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207564/ [7207566] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207566/ [7207568] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:11 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207568/ [7207572] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:19:54 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207572/ [7207574] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:16:29 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207574/ [7207577] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:15 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207577/ [7207580] orch/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr agent/on orchestrator_cli} time: 00:13:17 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207580/ [7207583] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:16:39 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207583/ [7207586] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:15:32 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207586/ [7207589] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:40:25 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207589/ [7207591] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:46:42 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207591/ [7207593] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:40:26 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207593/ [7207595] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/classic task/test_iscsi_pids_limit} time: 00:16:36 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207595/ [7207597] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:16:09 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207597/ [7207599] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:44 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207599/ [7207603] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:27 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207603/ [7207605] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:57 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207605/ [7207607] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:36:05 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207607/ [7207609] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:17:51 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207609/ [7207611] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:46:53 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207611/ [7207613] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:31:15 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207613/ [7207615] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:29 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207615/ [7207617] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:00 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207617/ [7207619] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:34:49 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207619/ [7207621] orch/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/classic task/test_orch_cli} time: 00:18:25 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207621/ [7207623] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207623/ [7207625] orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:17:43 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207625/ [7207627] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:15:32 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207627/ [7207629] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:48:40 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207629/ [7207631] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:26:14 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207631/ [7207633] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:15:54 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207633/ [7207635] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/connectivity task/test_orch_cli_mon} time: 00:35:00 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207635/ [7207637] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:00 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207637/ [7207639] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:19:09 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207639/ [7207641] orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:40 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207641/ [7207645] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:30 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207645/ [7207647] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_adoption} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207647/ [7207649] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:36:00 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207649/ [7207651] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} time: 00:16:26 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207651/ [7207654] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:35:40 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207654/ [7207657] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:52 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207657/ [7207660] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:16:46 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207660/ [7207663] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:32:03 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207663/ [7207666] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:53:14 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207666/ [7207669] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:37:54 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207669/ [7207672] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:39 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207672/ [7207675] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:15:22 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207675/ [7207678] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:24:39 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207678/ [7207684] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:15 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207684/ [7207687] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:35 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207687/ [7207690] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:40:54 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207690/ [7207693] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:28:00 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207693/ [7207696] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:19:32 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207696/ [7207699] orch/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/off mon_election/classic task/test_cephadm_repos} time: 00:09:32 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207699/ [7207702] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207702/ [7207704] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:15:50 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207704/ [7207706] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:28:37 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207706/ [7207708] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:23:32 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207708/ [7207710] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:35 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207710/ [7207712] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:31:10 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207712/ [7207714] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:14:51 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207714/ [7207716] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:40:09 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207716/ [7207718] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:28:31 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207718/ [7207720] orch/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/on mon_election/connectivity task/test_iscsi_pids_limit} time: 00:17:54 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207720/ [7207722] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:51 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207722/ [7207726] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:24 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207726/ [7207730] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:28 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207730/ [7207732] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:20:04 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207732/ [7207736] orch/cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} time: 00:16:56 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207736/ [7207738] orch/cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:15:53 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207738/ [7207740] orch/cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:02:58 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207740/ [7207742] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:53:24 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207742/ [7207744] orch/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:43:18 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207744/ [7207746] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:00 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207746/ [7207748] orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:19 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207748/ [7207750] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:09 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207750/ [7207752] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:23 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207752/ [7207754] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_orch_cli} time: 00:16:41 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207754/ [7207756] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:07 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207756/ [7207760] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:30 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207760/ [7207762] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:31:37 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207762/ [7207764] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:24:52 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207764/ [7207766] orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:17 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207766/ [7207770] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:14:14 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207770/ [7207772] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:35:14 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207772/ [7207774] orch/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:18 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207774/ [7207778] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:52 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207778/ [7207780] orch/cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:37:06 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207780/ [7207781] orch/cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:25:19 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207781/ [7207783] orch/cephadm/workunits/{0-distro/rhel_8.4_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207783/ [7207785] orch/cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:24:00 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207785/ [7207787] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:31 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207787/ [7207789] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:54 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207789/ [7207791] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:41 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207791/ [7207795] orch/cephadm/workunits/{0-distro/rhel_8.4_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} time: 00:20:03 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207795/ [7207799] orch/cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:35:37 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207799/ [7207801] orch/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} time: 00:15:53 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207801/ [7207803] orch/cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:31:31 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207803/ [7207805] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:49 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207805/ [7207807] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:42 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207807/ [7207810] orch/cephadm/smoke-singlehost/{0-random-distro$/{ubuntu_20.04} 1-start 2-services/basic 3-final} time: 00:17:33 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207810/ [7207811] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:38:57 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207811/ [7207813] orch/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:28:29 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207813/ [7207816] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:40:28 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207816/ [7207818] orch/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:47 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207818/ [7207819] orch/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:25 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207819/ [7207822] orch/cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:06:50 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207822/ [7207824] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:16:13 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207824/ [7207826] orch/cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:15:55 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207826/ [7207827] orch/cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:51:20 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207827/ [7207829] orch/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:27:35 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207829/ [7207831] orch/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:00 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207831/ [7207833] orch/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:20 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207833/ [7207835] orch/cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_pids_limit} time: 00:15:27 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207835/ [7207837] orch/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:37 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207837/ [7207839] orch/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:53:37 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207839/ [7207841] orch/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:23:32 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207841/ [7207843] orch/cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2023-03-14_21:24:51-orch-quincy-release-distro-default-smithi/7207843/