2023-02-13T18:42:34.829 INFO:root:teuthology version: 0.0.1.dev39+ga5875b2 2023-02-13T18:42:34.829 INFO:teuthology.results:subset: '1/8' 2023-02-13T18:42:34.829 INFO:teuthology.results:seed: '4460' 2023-02-15T16:40:22.185 INFO:root:teuthology version: 0.0.1.dev41+gfbbadb5 2023-02-15T16:40:22.385 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-02-15T17:30:26.358 INFO:teuthology.results:Tests finished! gathering results... 2023-02-15T17:30:33.264 INFO:scrape:Found 101 jobs 2023-02-15T17:30:34.748 INFO:scrape:Found 3 distinct failure reasons 2023-02-15T17:30:34.749 INFO:scrape:Failure: Command failed on smithi099 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c79aa86a-abd1-11ed-9ae5-001a4aab830c -e sha1=60b1e8026c4e50eaa31cc68cc29df68f03d07924 -- bash -c \'ceph versions | jq -e \'"\'"\'.osd | length == 2\'"\'"\'\'' 2023-02-15T17:30:34.750 INFO:scrape:2 jobs: ['7153036', '7153086'] 2023-02-15T17:30:34.750 INFO:scrape:suites intersection: ['2-repo_digest/defaut', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'mon_election/classic}', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools'] 2023-02-15T17:30:34.750 INFO:scrape:suites union: ['2-repo_digest/defaut', '3-upgrade/staggered', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'mon_election/classic}', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools'] 2023-02-15T17:30:34.751 INFO:scrape: 2023-02-15T17:30:34.751 INFO:scrape:Failure: Command failed on smithi131 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-02-15T17:30:34.751 INFO:scrape:1 jobs: ['7153027'] 2023-02-15T17:30:34.752 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'test_iscsi_pids_limit}}'] 2023-02-15T17:30:34.752 INFO:scrape: 2023-02-15T17:30:34.753 INFO:scrape:Failure: Test failure: test_create_export_via_apply (tasks.cephfs.test_nfs.TestNFS) 2023-02-15T17:30:34.753 INFO:scrape:1 jobs: ['7153075'] 2023-02-15T17:30:34.754 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_nfs}'] 2023-02-15T17:30:34.754 INFO:scrape: 2023-02-15T17:30:34.760 INFO:teuthology.results:Sending results to gabrioux@redhat.com: Test Run: gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/ failed: 4 dead: 0 running: 0 waiting: 0 queued: 0 passed: 97 Fail ================================================================= [7153027] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:07:32 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153027/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153027/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cf75dcc0e27d4563921b8d886f5f7139 Command failed on smithi131 with status 1: 'TESTDIR=/home/ubuntu/cephtest bash -s' [7153036] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:54:55 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153036/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153036/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1c6db77677fa4ebabd421c0462cbe1a1 Command failed on smithi099 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c79aa86a-abd1-11ed-9ae5-001a4aab830c -e sha1=60b1e8026c4e50eaa31cc68cc29df68f03d07924 -- bash -c \'ceph versions | jq -e \'"\'"\'.osd | length == 2\'"\'"\'\'' [7153075] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:37:43 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153075/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153075/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3cb9dbb3b57b47ce8c8502c7eb02d1ac Test failure: test_create_export_via_apply (tasks.cephfs.test_nfs.TestNFS) [7153086] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} ----------------------------------------------------------------- time: 00:56:24 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153086/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153086/ sentry: https://sentry.ceph.com/organizations/ceph/?query=03c77a68b5064427a4076ee0575f4383 Command failed on smithi057 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v16.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid fb83af3e-ad4b-11ed-9ae5-001a4aab830c -e sha1=60b1e8026c4e50eaa31cc68cc29df68f03d07924 -- bash -c \'ceph versions | jq -e \'"\'"\'.osd | length == 2\'"\'"\'\'' Pass ================================================================= [7153026] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:33 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153026/ [7153028] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:28:40 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153028/ [7153029] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:17:06 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153029/ [7153030] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:35:29 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153030/ [7153031] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:37:09 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153031/ [7153032] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/off orchestrator_cli} time: 00:16:55 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153032/ [7153033] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:37:03 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153033/ [7153034] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/basic 3-final} time: 00:14:49 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153034/ [7153035] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:58 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153035/ [7153037] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:28:40 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153037/ [7153038] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_nfs} time: 00:31:39 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153038/ [7153039] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:47 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153039/ [7153040] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:22 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153040/ [7153041] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:38:54 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153041/ [7153042] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:43:41 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153042/ [7153043] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_orch_cli} time: 00:19:38 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153043/ [7153044] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:18:33 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153044/ [7153045] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:26:00 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153045/ [7153046] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:29 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153046/ [7153047] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:15 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153047/ [7153048] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_orch_cli_mon} time: 00:26:09 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153048/ [7153049] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:26:50 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153049/ [7153050] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:37 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153050/ [7153051] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:28 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153051/ [7153052] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:59:21 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153052/ [7153053] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:43:29 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153053/ [7153054] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_adoption} time: 00:13:51 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153054/ [7153055] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:34 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153055/ [7153056] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:28:27 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153056/ [7153057] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:31:45 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153057/ [7153058] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:23 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153058/ [7153059] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:34:38 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153059/ [7153060] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_cephadm} time: 00:19:30 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153060/ [7153061] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:15:30 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153061/ [7153062] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:37:59 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153062/ [7153063] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:50 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153063/ [7153064] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:10:01 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153064/ [7153065] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:36:11 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153065/ [7153066] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:17:09 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153066/ [7153067] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:35:30 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153067/ [7153068] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:39:21 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153068/ [7153069] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:16:46 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153069/ [7153070] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:19:23 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153070/ [7153071] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:38:05 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153071/ [7153072] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:29:22 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153072/ [7153073] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:16:02 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153073/ [7153074] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} time: 00:31:07 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153074/ [7153076] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:22 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153076/ [7153077] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:16 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153077/ [7153078] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:40:05 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153078/ [7153079] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:43:42 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153079/ [7153080] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:25:09 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153080/ [7153081] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_orch_cli} time: 00:17:59 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153081/ [7153082] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:39 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153082/ [7153083] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli} time: 00:17:24 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153083/ [7153084] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools_crun} 1-start 2-services/rgw 3-final} time: 00:15:18 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153084/ [7153085] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:15:06 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153085/ [7153087] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:31:37 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153087/ [7153088] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:17:18 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153088/ [7153089] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:30:19 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153089/ [7153090] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} time: 00:28:04 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153090/ [7153091] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:39 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153091/ [7153092] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:05 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153092/ [7153093] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:16:21 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153093/ [7153094] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:43:05 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153094/ [7153095] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:39:50 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153095/ [7153096] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_adoption} time: 00:18:46 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153096/ [7153097] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:34:45 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153097/ [7153098] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:30:39 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153098/ [7153099] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} time: 00:22:51 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153099/ [7153100] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:16:23 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153100/ [7153101] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:32:17 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153101/ [7153102] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} time: 00:29:47 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153102/ [7153103] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} time: 00:09:58 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153103/ [7153104] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:16:28 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153104/ [7153105] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:17:07 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153105/ [7153106] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:55:36 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153106/ [7153107] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:45:05 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153107/ [7153108] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:32:22 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153108/ [7153109] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:51 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153109/ [7153110] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:37:50 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153110/ [7153111] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:19:14 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153111/ [7153112] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:17:36 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153112/ [7153113] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:26:34 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153113/ [7153114] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/jaeger 3-final} time: 00:19:53 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153114/ [7153115] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} time: 00:27:30 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153115/ [7153116] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_nfs} time: 00:32:03 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153116/ [7153117] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:15:46 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153117/ [7153118] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:25:39 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153118/ [7153119] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:45:09 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153119/ [7153120] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:41:21 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153120/ [7153121] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:34:41 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153121/ [7153122] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli} time: 00:18:56 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153122/ [7153123] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:22 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153123/ [7153124] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:28:50 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153124/ [7153125] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:16:11 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153125/ [7153126] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:36:39 info: http://pulpito.ceph.com/gabrioux-2023-02-07_12:49:10-orch:cephadm-wip-guits-testing-3-2023-02-07-1020-distro-default-smithi/7153126/