2022-03-11T10:00:08.864 INFO:root:teuthology version: 1.1.0-ff5db916 2022-03-11T10:00:08.866 INFO:teuthology.results:seed: '4306' 2022-03-11T14:11:08.519 INFO:root:teuthology version: 1.1.0-ff5db916 2022-03-11T14:11:08.529 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-11T15:07:13.733 INFO:teuthology.results:Tests finished! gathering results... 2022-03-11T15:07:39.575 INFO:scrape:Found 351 jobs 2022-03-11T15:07:45.992 INFO:scrape:Found 8 distinct failure reasons 2022-03-11T15:07:45.993 INFO:scrape:Failure: Command failed on smithi178 with status 125: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:cace17d9af0bb55ca5dedcc3feec55c9a734da6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3d359aa6-a12b-11ec-8c35-001a4aab830c -- ceph orch apply grafana '1;smithi178=a'" 2022-03-11T15:07:45.994 INFO:scrape:4 jobs: ['6731597', '6731542', '6731618', '6731748'] 2022-03-11T15:07:45.994 INFO:scrape:suites intersection: [] 2022-03-11T15:07:45.994 INFO:scrape:suites union: ['0-nvme-loop', '1-start', '2-services/nfs-ingress-rgw-user', '2-thrash', '3-final}', '3-tasks/rados_api_tests', '3-tasks/small-objects', 'fixed-2', 'mode/root', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'root}', 'start', 'tasks/rados_python}'] 2022-03-11T15:07:45.995 INFO:scrape: 2022-03-11T15:07:45.995 INFO:scrape:Failure: reached maximum tries (120) after waiting for 120 seconds 2022-03-11T15:07:45.996 INFO:scrape:1 jobs: ['6731758'] 2022-03-11T15:07:45.996 INFO:scrape:suites: ['0-nvme-loop', 'agent/on', 'fixed-2', 'mon_election/classic', 'orch:cephadm/smoke/{0-distro/ubuntu_20.04', 'start}'] 2022-03-11T15:07:45.997 INFO:scrape: 2022-03-11T15:07:45.997 INFO:scrape:Failure: No module named 'tasks' 2022-03-11T15:07:45.998 INFO:scrape:30 jobs 2022-03-11T15:07:45.998 INFO:scrape:suites intersection: [] 2022-03-11T15:07:45.999 INFO:scrape:suites union: ['0-nvme-loop', '1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-node-mgr', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '2-services/nfs', '2-services/nfs-ingress-rgw-bucket', '2-services/nfs-ingress-rgw-user', '2-services/nfs-ingress2', '2-services/nfs2', '2-services/rgw-ingress', '2-thrash', '3-final}', '3-inline/no', '3-inline/yes', '3-start-upgrade', '3-tasks/rados_api_tests', '3-tasks/radosbench', '3-tasks/small-objects', '3-tasks/snaps-few-objects', '3-upgrade-with-workload', '4-verify}', '4-verify}}', '4-wait', '5-upgrade-ls', 'agent/off', 'agent/on', 'centos_8.stream_container_tools', 'conf/{client', 'fixed-2', 'mds', 'mode/packaged', 'mode/root', 'mon', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools}', 'orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04', 'orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/thrash/{0-distro/ubuntu_20.04', 'orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools', 'orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'orch:cephadm/workunits/{agent/off', 'orchestrator_cli}', 'osd}', 'overrides/{pg-warn', 'roles', 'root}', 'start', 'start}', 'syntax', 'task/test_cephadm}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'tasks/{0-from/pacific', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-03-11T15:07:45.999 INFO:scrape: 2022-03-11T15:07:46.000 INFO:scrape:Failure: Command failed on smithi139 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11067-gcace17d9-1focal ceph-mds=17.0.0-11067-gcace17d9-1focal ceph-common=17.0.0-11067-gcace17d9-1focal ceph-fuse=17.0.0-11067-gcace17d9-1focal ceph-test=17.0.0-11067-gcace17d9-1focal radosgw=17.0.0-11067-gcace17d9-1focal python-ceph=17.0.0-11067-gcace17d9-1focal libcephfs1=17.0.0-11067-gcace17d9-1focal libcephfs-java=17.0.0-11067-gcace17d9-1focal libcephfs-jni=17.0.0-11067-gcace17d9-1focal librados2=17.0.0-11067-gcace17d9-1focal librbd1=17.0.0-11067-gcace17d9-1focal rbd-fuse=17.0.0-11067-gcace17d9-1focal' 2022-03-11T15:07:46.000 INFO:scrape:2 jobs: ['6731702', '6731693'] 2022-03-11T15:07:46.001 INFO:scrape:suites intersection: ['mon_election/classic'] 2022-03-11T15:07:46.001 INFO:scrape:suites union: ['fixed-2', 'mode/root', 'mon_election/classic', 'msgr/async-v2only', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'orch:cephadm/workunits/{agent/on', 'start', 'task/test_adoption}', 'tasks/rados_api_tests}'] 2022-03-11T15:07:46.002 INFO:scrape: 2022-03-11T15:07:46.002 INFO:scrape:Failure: Command failed on smithi055 with status 1: 'sudo yum -y install cephfs-java' 2022-03-11T15:07:46.002 INFO:scrape:7 jobs: ['6731697', '6731694', '6731704', '6731692', '6731696', '6731699', '6731701'] 2022-03-11T15:07:46.003 INFO:scrape:suites intersection: ['fixed-2'] 2022-03-11T15:07:46.003 INFO:scrape:suites union: ['1-start', '2-thrash', '3-tasks/rados_api_tests', '3-tasks/snaps-few-objects', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools', 'orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'root}', 'start', 'tasks/rados_api_tests}', 'tasks/rados_python}'] 2022-03-11T15:07:46.004 INFO:scrape: 2022-03-11T15:07:46.004 INFO:scrape:Dead: b'teuthology.exceptions.MaxWhileTries: reached maximum tries (60) after waiting for 600 seconds' 2022-03-11T15:07:46.005 INFO:scrape:3 jobs: ['6731707', '6731705', '6731708'] 2022-03-11T15:07:46.005 INFO:scrape: 2022-03-11T15:07:46.006 INFO:scrape:Failure: Config file not found: "/home/teuthworker/src/git.ceph.com_ceph-c_cace17d9af0bb55ca5dedcc3feec55c9a734da6b/qa/tasks/cephadm.conf". 2022-03-11T15:07:46.006 INFO:scrape:1 jobs: ['6731688'] 2022-03-11T15:07:46.007 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-services/nfs-ingress', '3-final}', 'orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools'] 2022-03-11T15:07:46.007 INFO:scrape: 2022-03-11T15:07:46.008 INFO:scrape:Failure: Test failure: test_export_create_with_non_existing_fsname (tasks.cephfs.test_nfs.TestNFS) 2022-03-11T15:07:46.008 INFO:scrape:1 jobs: ['6731568'] 2022-03-11T15:07:46.008 INFO:scrape:suites: ['mon_election/connectivity', 'orch:cephadm/workunits/{agent/on', 'task/test_nfs}'] 2022-03-11T15:07:46.009 INFO:scrape: 2022-03-11T15:07:46.020 INFO:teuthology.results:Sending results to rkachach@redhat.com: Test Run: rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/ failed: 46 dead: 5 running: 0 waiting: 0 queued: 0 passed: 302 Fail ================================================================= [6731542] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:05:29 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731542/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731542/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8b2cb29fd2c24576a3a21754dc75ca1d Command failed on smithi141 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:cace17d9af0bb55ca5dedcc3feec55c9a734da6b pull' [6731568] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_nfs} ----------------------------------------------------------------- time: 00:35:34 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731568/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731568/ sentry: https://sentry.ceph.com/organizations/ceph/?query=88845fc04af94ec6ac29f6847b12c5d6 Test failure: test_export_create_with_non_existing_fsname (tasks.cephfs.test_nfs.TestNFS) [6731597] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:15:46 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731597/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731597/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd80cf2ca0204e6cbe7e99bddf648dbe Command failed on smithi178 with status 125: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:cace17d9af0bb55ca5dedcc3feec55c9a734da6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 3d359aa6-a12b-11ec-8c35-001a4aab830c -- ceph orch apply grafana '1;smithi178=a'" [6731618] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:27:48 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731618/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731618/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7200e5ff97a24b3abb9fac3a42b25b19 Command failed on smithi174 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:cace17d9af0bb55ca5dedcc3feec55c9a734da6b shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid da5d579e-a12e-11ec-8c35-001a4aab830c -- ceph orch apply prometheus '1;smithi174=a'" [6731655] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:30:38 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731655/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731655/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b243b2e5d6c84b70920da51a0e1549dc No module named 'tasks.workunit' [6731665] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:21:25 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731665/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731665/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b8a4966bf4e4beea829c65c150b6f73 No module named 'tasks.cephadm' [6731668] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:20:34 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731668/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731668/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b020efdbd28a4b14ac22b37214a37a77 No module named 'tasks.cephadm' [6731671] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:20:28 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731671/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731671/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82806749d18840d0822ea2803bb7a803 No module named 'tasks.cephadm' [6731672] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:17:42 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731672/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731672/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5c46e9d4b5c64b4282d9eed7b5b9e3bc No module named 'tasks.workunit' [6731675] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:15:19 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731675/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731675/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b23f4d98d0e946e88aa52da4c412e0a8 No module named 'tasks.workunit' [6731676] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} ----------------------------------------------------------------- time: 00:19:41 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731676/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731676/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fcc6fd1c5903423392aade31b40475c6 No module named 'tasks.python' [6731677] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:20:26 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731677/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731677/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3243c2a677084438a63f11bd56bb0761 No module named 'tasks.cephadm' [6731678] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:14:57 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731678/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731678/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0677ecf10cb64eab9f92382fa7ac6a18 No module named 'tasks.workunit' [6731679] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:20:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731679/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731679/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc3eb6636a3c4d0a86bc1fa4d40c2481 No module named 'tasks.cephadm' [6731681] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} ----------------------------------------------------------------- time: 00:14:53 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731681/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731681/ sentry: https://sentry.ceph.com/organizations/ceph/?query=db0ab143af964855894c7d571ce383d9 No module named 'tasks.python' [6731682] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:18:41 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731682/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731682/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1450570c24724d88a8a36c2a8e5668f5 No module named 'tasks.thrashosds' [6731683] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:21:32 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731683/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731683/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0c38d5454d4c4035aab903ab5879bc1e No module named 'tasks.cephadm' [6731684] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:18:13 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731684/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731684/ sentry: https://sentry.ceph.com/organizations/ceph/?query=36c104984be94288b031c0e7c9408058 No module named 'tasks.workunit' [6731685] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:50 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731685/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731685/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ca49f466dbdd47d1ab5825c8a8a46fe8 No module named 'tasks.cephadm' [6731686] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr agent/on orchestrator_cli} ----------------------------------------------------------------- time: 00:07:48 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731686/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731686/ sentry: https://sentry.ceph.com/organizations/ceph/?query=70ed2f87c7df438d81c5f704135c781e No module named 'tasks.ceph' [6731687] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:09 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731687/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731687/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8a2223d18ae4255ac716669c8a07557 No module named 'tasks.nvme_loop' [6731688] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} ----------------------------------------------------------------- time: 00:05:40 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731688/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731688/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25cc4c6a612c4f7ea81bceda6871824c Config file not found: "/home/teuthworker/src/git.ceph.com_ceph- c_cace17d9af0bb55ca5dedcc3feec55c9a734da6b/qa/tasks/cephadm.conf". [6731690] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:08:21 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731690/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731690/ sentry: https://sentry.ceph.com/organizations/ceph/?query=20828474209e4ed2980821804aaa92a0 No module named 'tasks.cephadm' [6731691] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} ----------------------------------------------------------------- time: 00:05:01 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731691/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731691/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5fdd82f6426b45a889c20e27b98dc3c7 No module named 'tasks.cephadm' [6731692] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:06:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731692/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731692/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84bfd06f548e4b739e1de5d909a52b42 Command failed on smithi053 with status 1: 'sudo yum -y install cephfs- java' [6731693] orch:cephadm/workunits/{agent/on mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:03:12 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731693/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731693/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b4441483eb214fccb6234768d85f83aa Command failed on smithi083 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11067-gcace17d9-1focal ceph-mds=17.0.0-11067-gcace17d9-1focal ceph-common=17.0.0-11067-gcace17d9-1focal ceph- fuse=17.0.0-11067-gcace17d9-1focal ceph-test=17.0.0-11067-gcace17d9-1focal radosgw=17.0.0-11067-gcace17d9-1focal python- ceph=17.0.0-11067-gcace17d9-1focal libcephfs1=17.0.0-11067-gcace17d9-1focal libcephfs-java=17.0.0-11067-gcace17d9-1focal libcephfs- jni=17.0.0-11067-gcace17d9-1focal librados2=17.0.0-11067-gcace17d9-1focal librbd1=17.0.0-11067-gcace17d9-1focal rbd- fuse=17.0.0-11067-gcace17d9-1focal' [6731694] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:07:21 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731694/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731694/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8262b3afd0fa45d494a89a61f234f759 Command failed on smithi169 with status 1: 'sudo yum -y install cephfs- java' [6731695] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} ----------------------------------------------------------------- time: 00:05:08 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731695/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731695/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59e0c87bed134c1d9a076930b5ca0bf2 No module named 'tasks.nvme_loop' [6731696] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:06:45 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731696/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731696/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2ed73a73121d43eea35119a10835f37a Command failed on smithi014 with status 1: 'sudo yum -y install cephfs- java' [6731697] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:14:24 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731697/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731697/ sentry: https://sentry.ceph.com/organizations/ceph/?query=13ffc01db54743df98368d7a000a3882 Command failed on smithi055 with status 1: 'sudo yum -y install cephfs- java' [6731698] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:05:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731698/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731698/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5247635b57e3414ab8f9c321d8895a9d No module named 'tasks.nvme_loop' [6731699] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:14:09 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731699/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731699/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0a7901d2a29d4df0a04e0cbb296901c1 Command failed on smithi196 with status 1: 'sudo yum -y install cephfs- java' [6731700] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} ----------------------------------------------------------------- time: 00:10:09 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731700/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731700/ sentry: https://sentry.ceph.com/organizations/ceph/?query=210558def03d4b75a066663de6f63260 No module named 'tasks.nvme_loop' [6731701] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} ----------------------------------------------------------------- time: 00:13:40 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731701/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731701/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e771e474c1a44d7ebe168353e7349504 Command failed on smithi143 with status 1: 'sudo yum -y install cephfs- java' [6731702] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:03:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731702/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731702/ sentry: https://sentry.ceph.com/organizations/ceph/?query=88aa68f227b544a7900f37dfd8fb7691 Command failed on smithi139 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::=" --force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-11067-gcace17d9-1focal ceph-mds=17.0.0-11067-gcace17d9-1focal ceph-common=17.0.0-11067-gcace17d9-1focal ceph- fuse=17.0.0-11067-gcace17d9-1focal ceph-test=17.0.0-11067-gcace17d9-1focal radosgw=17.0.0-11067-gcace17d9-1focal python- ceph=17.0.0-11067-gcace17d9-1focal libcephfs1=17.0.0-11067-gcace17d9-1focal libcephfs-java=17.0.0-11067-gcace17d9-1focal libcephfs- jni=17.0.0-11067-gcace17d9-1focal librados2=17.0.0-11067-gcace17d9-1focal librbd1=17.0.0-11067-gcace17d9-1focal rbd- fuse=17.0.0-11067-gcace17d9-1focal' [6731703] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} ----------------------------------------------------------------- time: 00:03:14 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731703/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731703/ sentry: https://sentry.ceph.com/organizations/ceph/?query=005b70ba3ffc4e42ada342b51b635431 No module named 'tasks.cephadm' [6731704] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:28 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731704/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731704/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dd1fc898208643cf96fc2f1c7ca0dcbb Command failed on smithi135 with status 1: 'sudo yum -y install cephfs- java' [6731706] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} ----------------------------------------------------------------- time: 00:10:36 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731706/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731706/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8738c7d2abc8460a93d1c2994322582c No module named 'tasks.nvme_loop' [6731709] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:04:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731709/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731709/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ff389dcf38644a13a53beeacac77522e No module named 'tasks' [6731710] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:20:30 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731710/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731710/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7417aa49ec29470da664fc774b2b672a No module named 'tasks' [6731711] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} ----------------------------------------------------------------- time: 00:10:14 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731711/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731711/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e1096cd090da47609ee559b619cec968 No module named 'tasks' [6731712] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:07:43 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731712/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731712/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4020a7ed281d48feb237df4cb2827812 No module named 'tasks' [6731713] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:03:11 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731713/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731713/ sentry: https://sentry.ceph.com/organizations/ceph/?query=922104ff3aa24cff9a7fc5cc0744fc6d No module named 'tasks' [6731714] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:04:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731714/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731714/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a17ff7c2ece6453fb6cf295dadfe7e12 No module named 'tasks' [6731748] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:36:41 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731748/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731748/ Command failed on smithi040 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:cace17d9af0bb55ca5dedcc3feec55c9a734da6b shell --fsid 28f9cfc2-a13e-11ec-8c35-001a4aab830c -- ceph tell osd.0 flush_pg_stats' [6731758] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:23:34 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731758/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731758/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ddf1c43e15b54581b3fd3798442f2af4 reached maximum tries (120) after waiting for 120 seconds Dead ================================================================= [6731705] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731705/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731705/ [6731707] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731707/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731707/ [6731708] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731708/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731708/ [6731715] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731715/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731715/ 'cace17d9af0bb55ca5dedcc3feec55c9a734da6b' not found in repo: git://git.ceph.com/ceph-ci.git! [6731716] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731716/ log: http://qa-proxy.ceph.com/teuthology/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731716/ reached maximum tries (60) after waiting for 600 seconds Pass ================================================================= [6731507] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:02 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731507/ [6731508] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:33:28 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731508/ [6731509] orch:cephadm/orchestrator_cli/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 2-node-mgr agent/off orchestrator_cli} time: 00:26:56 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731509/ [6731510] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:11:13 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731510/ [6731511] orch:cephadm/rbd_iscsi/{0-single-container-host base/install cluster/{fixed-3 openstack} workloads/cephadm_iscsi} time: 00:27:23 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731511/ [6731512] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:12:29 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731512/ [6731513] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:11:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731513/ [6731514] orch:cephadm/smoke-singlehost/{0-random-distro$/{rhel_8.4_container_tools_rhel8} 1-start 2-services/basic 3-final} time: 00:16:58 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731514/ [6731515] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:33:29 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731515/ [6731516] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:24:49 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731516/ [6731517] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:34:10 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731517/ [6731518] orch:cephadm/workunits/{agent/off mon_election/classic task/test_adoption} time: 00:07:26 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731518/ [6731519] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:20:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731519/ [6731520] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:11:44 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731520/ [6731521] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:49:04 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731521/ [6731522] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:46:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731522/ [6731523] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:36:47 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731523/ [6731524] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:17:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731524/ [6731525] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:44:10 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731525/ [6731526] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:37:05 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731526/ [6731527] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:11:23 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731527/ [6731528] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:30:05 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731528/ [6731529] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:20:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731529/ [6731530] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731530/ [6731531] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:18:36 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731531/ [6731532] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:49:16 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731532/ [6731533] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:33:35 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731533/ [6731534] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm} time: 00:15:41 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731534/ [6731535] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:36:43 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731535/ [6731536] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:00 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731536/ [6731537] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:15:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731537/ [6731538] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:39:33 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731538/ [6731539] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:47:15 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731539/ [6731540] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:24:44 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731540/ [6731541] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:17:47 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731541/ [6731543] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:49:21 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731543/ [6731544] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:30:19 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731544/ [6731545] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:34:08 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731545/ [6731546] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:21:21 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731546/ [6731547] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:19:43 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731547/ [6731548] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:14:37 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731548/ [6731549] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:27:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731549/ [6731550] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:47:13 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731550/ [6731551] orch:cephadm/workunits/{agent/off mon_election/classic task/test_cephadm_repos} time: 00:04:29 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731551/ [6731552] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:35:05 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731552/ [6731553] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:21:57 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731553/ [6731554] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:49:12 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731554/ [6731555] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:36:24 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731555/ [6731556] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:15 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731556/ [6731557] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:56 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731557/ [6731558] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:25:07 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731558/ [6731559] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:21:46 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731559/ [6731560] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:19 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731560/ [6731561] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:47:09 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731561/ [6731562] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:34:20 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731562/ [6731563] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:37:56 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731563/ [6731564] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:55 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731564/ [6731565] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:13:01 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731565/ [6731566] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:54:43 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731566/ [6731567] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:47:10 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731567/ [6731569] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:24:07 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731569/ [6731570] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:10 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731570/ [6731571] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:15:51 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731571/ [6731572] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:27:58 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731572/ [6731573] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:30:13 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731573/ [6731574] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:33:43 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731574/ [6731575] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:21:40 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731575/ [6731576] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:12:54 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731576/ [6731577] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:34:55 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731577/ [6731578] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:48:20 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731578/ [6731579] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:28 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731579/ [6731580] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:36:31 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731580/ [6731581] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:44 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731581/ [6731582] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:15:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731582/ [6731583] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:35 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731583/ [6731584] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:49:12 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731584/ [6731585] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:36:33 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731585/ [6731586] orch:cephadm/workunits/{agent/off mon_election/classic task/test_orch_cli} time: 00:13:28 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731586/ [6731587] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:31:26 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731587/ [6731588] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:22:13 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731588/ [6731589] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:18:23 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731589/ [6731590] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 01:03:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731590/ [6731591] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:33:39 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731591/ [6731592] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:35:14 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731592/ [6731593] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:13:30 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731593/ [6731594] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:36:04 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731594/ [6731595] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:48:56 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731595/ [6731596] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:12:05 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731596/ [6731598] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:21 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731598/ [6731599] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:12:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731599/ [6731600] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:11:43 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731600/ [6731601] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:34:38 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731601/ [6731602] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:25:18 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731602/ [6731603] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:32:55 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731603/ [6731604] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_adoption} time: 00:07:26 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731604/ [6731605] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:21:06 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731605/ [6731606] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:12:41 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731606/ [6731607] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:32:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731607/ [6731608] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:47:27 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731608/ [6731609] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:35:14 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731609/ [6731610] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:12:06 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731610/ [6731611] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:11 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731611/ [6731612] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 01:00:51 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731612/ [6731613] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:37:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731613/ [6731614] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:30:27 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731614/ [6731615] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:22:07 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731615/ [6731616] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:12:21 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731616/ [6731617] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:21:13 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731617/ [6731619] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:33:41 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731619/ [6731620] orch:cephadm/workunits/{agent/off mon_election/classic task/test_cephadm} time: 00:15:31 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731620/ [6731621] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:36:20 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731621/ [6731622] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:57 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731622/ [6731623] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731623/ [6731624] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:40:12 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731624/ [6731625] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:47:18 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731625/ [6731626] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:18:10 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731626/ [6731627] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:24:41 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731627/ [6731628] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:24:27 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731628/ [6731629] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:12:27 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731629/ [6731630] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:33:01 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731630/ [6731631] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:30:24 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731631/ [6731632] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:32:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731632/ [6731633] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:20:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731633/ [6731634] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:14 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731634/ [6731635] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:11:57 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731635/ [6731636] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:56:57 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731636/ [6731637] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:47:21 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731637/ [6731638] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_cephadm_repos} time: 00:04:28 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731638/ [6731639] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:35:22 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731639/ [6731640] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:19:26 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731640/ [6731641] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:21:31 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731641/ [6731642] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:42:56 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731642/ [6731643] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:38:49 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731643/ [6731644] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:27:24 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731644/ [6731645] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:24:38 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731645/ [6731646] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:21:13 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731646/ [6731647] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:22:42 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731647/ [6731648] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:47:37 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731648/ [6731649] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:33:24 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731649/ [6731650] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:35:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731650/ [6731651] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/repave-all} time: 00:17:37 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731651/ [6731652] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/classic start} time: 00:20:03 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731652/ [6731653] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:12:39 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731653/ [6731654] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:43:45 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731654/ [6731656] orch:cephadm/workunits/{agent/off mon_election/classic task/test_nfs} time: 00:23:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731656/ [6731657] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:24:15 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731657/ [6731658] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:11:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731658/ [6731659] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:51:53 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731659/ [6731660] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:30:12 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731660/ [6731661] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:33:02 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731661/ [6731662] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:20:58 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731662/ [6731663] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:11:39 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731663/ [6731664] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:32:32 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731664/ [6731666] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:34:40 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731666/ [6731667] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:13:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731667/ [6731669] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/on fixed-2 mon_election/connectivity start} time: 00:19:16 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731669/ [6731670] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:16 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731670/ [6731673] orch:cephadm/workunits/{agent/on mon_election/connectivity task/test_orch_cli} time: 00:14:30 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731673/ [6731674] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:31:04 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731674/ [6731680] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:11:54 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731680/ [6731689] orch:cephadm/smoke-singlehost/{0-random-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:12:08 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731689/ [6731717] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:14:06 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731717/ [6731718] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:39:15 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731718/ [6731719] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:32:13 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731719/ [6731720] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:36:19 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731720/ [6731721] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:57 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731721/ [6731722] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:21:05 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731722/ [6731723] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:23:32 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731723/ [6731724] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:15:10 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731724/ [6731725] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:35:16 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731725/ [6731726] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:50:14 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731726/ [6731727] orch:cephadm/workunits/{agent/on mon_election/classic task/test_cephadm_repos} time: 00:04:58 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731727/ [6731728] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:35:49 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731728/ [6731729] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:19:07 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731729/ [6731730] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 01:04:32 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731730/ [6731731] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:37:15 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731731/ [6731732] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:26 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731732/ [6731733] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:25:28 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731733/ [6731734] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:23:42 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731734/ [6731735] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:22:20 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731735/ [6731736] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:43:35 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731736/ [6731737] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:36:44 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731737/ [6731738] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:21:04 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731738/ [6731739] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:36:25 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731739/ [6731740] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:22:38 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731740/ [6731741] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:15:08 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731741/ [6731742] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:45:05 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731742/ [6731743] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:48:26 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731743/ [6731744] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_nfs} time: 00:24:04 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731744/ [6731745] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:29:06 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731745/ [6731746] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:33:14 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731746/ [6731747] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:17:15 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731747/ [6731749] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/classic} time: 00:30:51 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731749/ [6731750] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:36:51 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731750/ [6731751] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:22:11 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731751/ [6731752] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:12 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731752/ [6731753] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:13:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731753/ [6731754] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:52:07 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731754/ [6731755] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:48:30 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731755/ [6731756] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:58 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731756/ [6731757] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:37:32 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731757/ [6731759] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:23:30 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731759/ [6731760] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:44:09 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731760/ [6731761] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:39:40 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731761/ [6731762] orch:cephadm/workunits/{agent/on mon_election/classic task/test_orch_cli} time: 00:18:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731762/ [6731763] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/connectivity} time: 00:32:20 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731763/ [6731764] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:24:37 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731764/ [6731765] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:26:06 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731765/ [6731766] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:50:04 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731766/ [6731767] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:37:29 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731767/ [6731768] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:33 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731768/ [6731769] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:36:32 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731769/ [6731770] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:16:25 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731770/ [6731771] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:44:51 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731771/ [6731772] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:48:55 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731772/ [6731773] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_python} time: 00:29:36 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731773/ [6731774] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:39 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731774/ [6731775] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:36 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731775/ [6731776] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:15:35 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731776/ [6731777] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:52:33 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731777/ [6731778] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:25:44 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731778/ [6731779] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:33:10 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731779/ [6731780] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_adoption} time: 00:07:24 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731780/ [6731781] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:20:48 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731781/ [6731782] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:11:42 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731782/ [6731783] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:15:11 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731783/ [6731784] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:29:45 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731784/ [6731785] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:48:39 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731785/ [6731786] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:36:56 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731786/ [6731787] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:20:09 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731787/ [6731788] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:49:56 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731788/ [6731789] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:36:49 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731789/ [6731790] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:30:18 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731790/ [6731791] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:21:33 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731791/ [6731792] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-ops/repave-all} time: 00:11:18 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731792/ [6731793] orch:cephadm/smoke/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:12:27 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731793/ [6731794] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:17:39 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731794/ [6731795] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:48:12 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731795/ [6731796] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:33:34 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731796/ [6731797] orch:cephadm/workunits/{agent/on mon_election/classic task/test_cephadm} time: 00:16:53 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731797/ [6731798] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:36:25 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731798/ [6731799] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:53 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731799/ [6731800] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:13:37 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731800/ [6731801] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:54:42 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731801/ [6731802] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:47:16 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731802/ [6731803] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:24:21 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731803/ [6731804] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:11:51 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731804/ [6731805] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:29:01 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731805/ [6731806] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:31:07 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731806/ [6731807] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:33:16 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731807/ [6731808] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:18:13 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731808/ [6731809] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:21:09 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731809/ [6731810] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:19:26 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731810/ [6731811] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:12:44 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731811/ [6731812] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:33:33 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731812/ [6731813] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:47:23 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731813/ [6731814] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_cephadm_repos} time: 00:04:30 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731814/ [6731815] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:36:20 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731815/ [6731816] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:19:42 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731816/ [6731817] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:49:47 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731817/ [6731818] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:36:48 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731818/ [6731819] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:41 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731819/ [6731820] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:24:48 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731820/ [6731821] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:22:04 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731821/ [6731822] orch:cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:18:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731822/ [6731823] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:20:18 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731823/ [6731824] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 01:03:25 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731824/ [6731825] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:34:16 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731825/ [6731826] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:35:17 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731826/ [6731827] orch:cephadm/smoke/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop agent/on fixed-2 mon_election/classic start} time: 00:20:35 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731827/ [6731828] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:33 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731828/ [6731829] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:34:35 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731829/ [6731830] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:50:45 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731830/ [6731831] orch:cephadm/workunits/{agent/on mon_election/classic task/test_nfs} time: 00:28:15 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731831/ [6731832] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:24:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731832/ [6731833] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:16:11 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731833/ [6731834] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:34:01 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731834/ [6731835] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls agent/on mon_election/classic} time: 00:30:31 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731835/ [6731836] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:33:48 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731836/ [6731837] orch:cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:13:24 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731837/ [6731838] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:21:10 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731838/ [6731839] orch:cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools_crun 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:11:52 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731839/ [6731840] orch:cephadm/thrash/{0-distro/centos_8.stream_container_tools_crun 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:34:14 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731840/ [6731841] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:47:31 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731841/ [6731842] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn syntax whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:59 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731842/ [6731843] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:36:25 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731843/ [6731844] orch:cephadm/smoke/{0-distro/ubuntu_20.04 0-nvme-loop agent/off fixed-2 mon_election/connectivity start} time: 00:16:30 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731844/ [6731845] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:18:44 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731845/ [6731846] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 01:02:21 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731846/ [6731847] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:37:06 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731847/ [6731848] orch:cephadm/workunits/{agent/off mon_election/connectivity task/test_orch_cli} time: 00:14:35 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731848/ [6731849] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls agent/off mon_election/connectivity} time: 00:31:25 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731849/ [6731850] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:22:48 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731850/ [6731851] orch:cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:12:43 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731851/ [6731852] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:22:30 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731852/ [6731853] orch:cephadm/thrash/{0-distro/rhel_8.4_container_tools_rhel8 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:44:08 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731853/ [6731854] orch:cephadm/with-work/{0-distro/centos_8.stream_container_tools_crun fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:35:04 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731854/ [6731855] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:35:55 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731855/ [6731856] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:18:39 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731856/ [6731857] orch:cephadm/thrash/{0-distro/ubuntu_20.04 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:41:35 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731857/ [6731858] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:47:43 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731858/ [6731859] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:24:23 info: http://pulpito.ceph.com/rkachach-2022-03-11_09:59:36-orch:cephadm-wip-rkachach-testing-2022-03-10-1113-distro-default-smithi/6731859/