2024-03-07T07:20:28.980 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-07T07:20:28.980 INFO:teuthology.results:subset: '1/8' 2024-03-07T07:20:28.980 INFO:teuthology.results:seed: '1228' 2024-03-07T08:40:26.616 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-03-07T08:40:26.654 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2024-03-07T09:29:30.914 INFO:teuthology.results:Tests finished! gathering results... 2024-03-07T09:29:38.143 INFO:scrape:Found 117 jobs 2024-03-07T09:29:42.159 INFO:scrape:Found 5 distinct failure reasons 2024-03-07T09:29:42.160 INFO:scrape:Failure: reached maximum tries (51) after waiting for 300 seconds 2024-03-07T09:29:42.160 INFO:scrape:9 jobs: ['7584216', '7584171', '7584198', '7584159', '7584230', '7584139', '7584229', '7584185', '7584245'] 2024-03-07T09:29:42.160 INFO:scrape:suites intersection: [] 2024-03-07T09:29:42.161 INFO:scrape:suites union: ['0-nvme-loop', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client/fuse', '2-services/jaeger', '3-final}', '3-inline/no', '3-upgrade-mgr-staggered', '4-config-upgrade/{fail_fs}', '4-verify}', '5-upgrade-with-workload', '6-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fail_fs/no', 'ignorelist_upgrade', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'osd}', 'overrides/{ignorelist_health', 'pg-warn', 'roles', 'syntax}', 'tasks/{0-from/pacific', 'tasks/{0-from/quincy', 'tasks/{0-from/reef/{reef}', 'tasks/{0-from/reef/{v18.2.0}', 'tasks/{0-from/v16.2.4'] 2024-03-07T09:29:42.161 INFO:scrape: 2024-03-07T09:29:42.161 INFO:scrape:Failure: Command failed on smithi169 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:23591e7aad58a7a3c454fb9c6f5883b52adadada shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c78b6060-dc5b-11ee-95c6-87774f69a715 -- ceph orch host add smithi172' 2024-03-07T09:29:42.161 INFO:scrape:1 jobs: ['7584200'] 2024-03-07T09:29:42.161 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/rgw-ingress', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools'] 2024-03-07T09:29:42.161 INFO:scrape: 2024-03-07T09:29:42.161 INFO:scrape:Failure: Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) 2024-03-07T09:29:42.161 INFO:scrape:1 jobs: ['7584239'] 2024-03-07T09:29:42.161 INFO:scrape:suites: ['agent/on', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun', 'task/test_orch_cli}'] 2024-03-07T09:29:42.161 INFO:scrape: 2024-03-07T09:29:42.162 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=23591e7aad58a7a3c454fb9c6f5883b52adadada TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2024-03-07T09:29:42.162 INFO:scrape:2 jobs: ['7584177', '7584223'] 2024-03-07T09:29:42.162 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2024-03-07T09:29:42.162 INFO:scrape:suites union: ['agent/off', 'agent/on', 'mon_election/classic', 'mon_election/connectivity', 'orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8', 'orch:cephadm/workunits/{0-distro/ubuntu_20.04', 'task/test_cephadm}'] 2024-03-07T09:29:42.162 INFO:scrape: 2024-03-07T09:29:42.162 INFO:scrape:Failure: '2024-03-07T09:04:13.018858+00:00 smithi027 kernel: rcu: INFO: rcu_sched detected stalls on CPUs/tasks: ' in syslog 2024-03-07T09:29:42.162 INFO:scrape:1 jobs: ['7584220'] 2024-03-07T09:29:42.162 INFO:scrape:suites: ['1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools'] 2024-03-07T09:29:42.162 INFO:scrape: 2024-03-07T09:29:42.166 INFO:teuthology.results:Sending results to gabrioux@ibm.com: Test Run: gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/ failed: 14 dead: 0 running: 0 waiting: 0 queued: 0 passed: 103 Fail ================================================================= [7584139] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:42:00 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584139/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584139/ reached maximum tries (51) after waiting for 300 seconds [7584159] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:40:37 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584159/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584159/ reached maximum tries (51) after waiting for 300 seconds [7584171] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.0} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:39:55 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584171/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584171/ reached maximum tries (51) after waiting for 300 seconds [7584177] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:10:08 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584177/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584177/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3de2d70de169426ab90980871216c69b Command failed (workunit test cephadm/test_cephadm.sh) on smithi033 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=23591e7aad58a7a3c454fb9c6f5883b52adadada TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7584185] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:40:45 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584185/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584185/ reached maximum tries (51) after waiting for 300 seconds [7584198] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:41:10 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584198/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584198/ reached maximum tries (51) after waiting for 300 seconds [7584200] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:08:46 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584200/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584200/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ad46bcf5436c40d49f0af258109b6b2b Command failed on smithi169 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay-quay- quay.apps.os.sepia.ceph.com/ceph- ci/ceph:23591e7aad58a7a3c454fb9c6f5883b52adadada shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c78b6060-dc5b-11ee-95c6-87774f69a715 -- ceph orch host add smithi172' [7584216] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:42:38 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584216/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584216/ reached maximum tries (51) after waiting for 300 seconds [7584220] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:49:25 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584220/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584220/ '2024-03-07T09:04:13.018858+00:00 smithi027 kernel: rcu: INFO: rcu_sched detected stalls on CPUs/tasks: ' in syslog [7584223] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:20:41 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584223/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584223/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8f92cb39b70b41a299d15beb6fbb48c9 Command failed (workunit test cephadm/test_cephadm.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=23591e7aad58a7a3c454fb9c6f5883b52adadada TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [7584229] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:40:21 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584229/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584229/ reached maximum tries (51) after waiting for 300 seconds [7584230] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/jaeger 3-final} ----------------------------------------------------------------- time: 00:36:00 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584230/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584230/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da0180b63cda435f84eaead8162c9f8f reached maximum tries (301) after waiting for 300 seconds [7584239] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:17:41 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584239/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584239/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5b5e7a79ed6c4dacb55f44551d69b267 Test failure: test_cephfs_mirror (tasks.cephadm_cases.test_cli.TestCephadmCLI) [7584245] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} ----------------------------------------------------------------- time: 00:41:05 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584245/ log: http://qa-proxy.ceph.com/teuthology/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584245/ reached maximum tries (51) after waiting for 300 seconds Pass ================================================================= [7584136] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:15:28 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584136/ [7584137] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:27:39 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584137/ [7584138] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:18:02 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584138/ [7584140] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.0 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:44:59 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584140/ [7584141] orch:cephadm/nfs/{cluster/{1-node} overrides/ignorelist_health supported-random-distros$/{rhel_8} tasks/nfs} time: 00:36:23 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584141/ [7584142] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools_crun} 2-node-mgr agent/off orchestrator_cli} time: 00:14:11 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584142/ [7584143] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} conf/{disable-pool-app} workloads/cephadm_iscsi} time: 00:47:56 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584143/ [7584144] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:24 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584144/ [7584145] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:17:29 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584145/ [7584146] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:13:29 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584146/ [7584147] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:50:00 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584147/ [7584148] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:32:03 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584148/ [7584149] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli} time: 00:22:37 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584149/ [7584150] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:16:56 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584150/ [7584151] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:17:18 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584151/ [7584152] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:43:34 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584152/ [7584153] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:44:19 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584153/ [7584154] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:36:09 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584154/ [7584155] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:22:26 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584155/ [7584156] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:26:10 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584156/ [7584157] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:16:32 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584157/ [7584158] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:43 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584158/ [7584160] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:18:04 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584160/ [7584161] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rotate-keys} time: 00:26:29 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584161/ [7584162] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_set_mon_crush_locations} time: 00:19:34 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584162/ [7584163] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:35:28 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584163/ [7584164] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:25:34 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584164/ [7584165] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:22:11 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584165/ [7584166] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:57:45 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584166/ [7584167] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:50:46 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584167/ [7584168] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_adoption} time: 00:22:46 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584168/ [7584169] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:28:08 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584169/ [7584170] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/off mon_election/classic task/test_ca_signed_key} time: 00:23:11 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584170/ [7584172] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:29 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584172/ [7584173] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:14:05 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584173/ [7584174] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:35:13 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584174/ [7584175] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:20:08 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584175/ [7584176] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rotate-keys} time: 00:37:33 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584176/ [7584178] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-keepalive-only 3-final} time: 00:17:22 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584178/ [7584179] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:45:55 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584179/ [7584180] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:18:05 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584180/ [7584181] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:35:28 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584181/ [7584182] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:40:39 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584182/ [7584183] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_cephadm_repos} time: 00:08:17 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584183/ [7584184] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:21:07 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584184/ [7584186] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:58 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584186/ [7584187] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/on mon_election/connectivity task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:17:01 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584187/ [7584188] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:20 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584188/ [7584189] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} time: 00:34:59 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584189/ [7584190] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli} time: 00:24:13 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584190/ [7584191] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:36:11 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584191/ [7584192] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:17:18 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584192/ [7584193] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nvmeof 3-final} time: 00:18:41 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584193/ [7584194] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:36 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584194/ [7584195] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:39:52 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584195/ [7584196] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:44:13 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584196/ [7584197] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_orch_cli_mon} time: 00:33:26 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584197/ [7584199] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.6_container_tools_3.0} 2-node-mgr agent/on orchestrator_cli} time: 00:23:58 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584199/ [7584201] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.6_container_tools_rhel8} 1-start 2-services/rgw 3-final} time: 00:16:14 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584201/ [7584202] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:13:58 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584202/ [7584203] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:49:24 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584203/ [7584204] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:32:36 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584204/ [7584205] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/off mon_election/classic task/test_rgw_multisite} time: 00:18:57 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584205/ [7584206] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:17:24 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584206/ [7584207] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} time: 00:25:42 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584207/ [7584208] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/on mon_election/connectivity task/test_set_mon_crush_locations} time: 00:20:03 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584208/ [7584209] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{reef} 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:01 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584209/ [7584210] orch:cephadm/osds/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:16:35 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584210/ [7584211] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:22:23 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584211/ [7584212] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:20:42 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584212/ [7584213] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:46:30 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584213/ [7584214] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:38:49 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584214/ [7584215] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools_crun agent/off mon_election/classic task/test_adoption} time: 00:12:24 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584215/ [7584217] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:30:09 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584217/ [7584218] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/on mon_election/connectivity task/test_ca_signed_key} time: 00:25:05 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584218/ [7584219] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:17:10 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584219/ [7584221] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:37:14 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584221/ [7584222] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} time: 00:33:57 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584222/ [7584224] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:18:28 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584224/ [7584225] orch:cephadm/smoke/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:18:18 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584225/ [7584226] orch:cephadm/thrash/{0-distro/rhel_8.6_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:53:39 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584226/ [7584227] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:43:02 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584227/ [7584228] orch:cephadm/workunits/{0-distro/ubuntu_20.04 agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:07:22 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584228/ [7584231] orch:cephadm/smoke-small/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:13:26 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584231/ [7584232] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-upgrade/simple 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:34:17 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584232/ [7584233] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:44 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584233/ [7584234] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:25:29 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584234/ [7584235] orch:cephadm/workunits/{0-distro/centos_8.stream_container_tools agent/off mon_election/classic task/test_iscsi_container/{centos_8.stream_container_tools test_iscsi_container}} time: 00:16:12 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584235/ [7584236] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:50 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584236/ [7584237] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:38:28 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584237/ [7584238] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rotate-keys} time: 00:26:34 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584238/ [7584240] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-haproxy-proto 3-final} time: 00:21:14 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584240/ [7584241] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:24:54 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584241/ [7584242] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:44:38 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584242/ [7584243] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:46:25 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584243/ [7584244] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_3.0 agent/off mon_election/classic task/test_orch_cli_mon} time: 00:36:39 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584244/ [7584246] orch:cephadm/smoke-roleless/{0-distro/rhel_8.6_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:18:06 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584246/ [7584247] orch:cephadm/with-work/{0-distro/rhel_8.6_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:27:11 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584247/ [7584248] orch:cephadm/workunits/{0-distro/rhel_8.6_container_tools_rhel8 agent/on mon_election/connectivity task/test_rgw_multisite} time: 00:23:25 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584248/ [7584249] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:15:11 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584249/ [7584250] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} time: 00:40:56 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584250/ [7584251] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:21:01 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584251/ [7584252] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rotate-keys} time: 00:37:40 info: https://pulpito.ceph.com/gabrioux-2024-03-07_07:18:10-orch:cephadm-wip-guits-testing-5-2024-03-06-1358-distro-default-smithi/7584252/