2021-10-14T09:13:12.482 INFO:root:teuthology version: 1.1.0-e4202151 2021-10-14T09:13:12.486 INFO:teuthology.results:subset: '0/3' 2021-10-14T09:13:12.486 INFO:teuthology.results:seed: '7633' 2021-10-14T12:42:56.626 INFO:root:teuthology version: 1.1.0-e4202151 2021-10-14T12:42:56.661 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-14T13:35:00.761 INFO:teuthology.results:Tests finished! gathering results... 2021-10-14T13:35:07.795 INFO:scrape:Found 97 jobs 2021-10-14T13:35:09.976 INFO:scrape:Found 2 distinct failure reasons 2021-10-14T13:35:09.977 INFO:scrape:Failure: timeout expired in wait_until_healthy 2021-10-14T13:35:09.977 INFO:scrape:11 jobs: ['6442826', '6442798', '6442859', '6442790', '6442810', '6442796', '6442855', '6442779', '6442867', '6442825', '6442829'] 2021-10-14T13:35:09.978 INFO:scrape:suites intersection: ['fixed-2'] 2021-10-14T13:35:09.978 INFO:scrape:suites union: ['1-start', '2-thrash', '3-tasks/small-objects', '3-tasks/snaps-few-objects', 'distro/centos_8.2_container_tools_3.0', 'distro/centos_8.3_container_tools_3.0', 'distro/rhel_8.4_container_tools_rhel8', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async-v1only', 'msgr/async-v2only', 'orch:cephadm/smoke/{0-nvme-loop', 'orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0', 'orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8', 'orch:cephadm/with-work/{0-distro/ubuntu_20.04', 'root}', 'start', 'start}', 'tasks/rados_api_tests}', 'tasks/rados_python}'] 2021-10-14T13:35:09.979 INFO:scrape: 2021-10-14T13:35:09.979 INFO:scrape:Failure: Command failed on smithi175 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:c80877c64b21ea0ed140e531c8bff3a0eaab10f3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c983464-2ce9-11ec-8c27-001a4aab830c -- ceph mon dump -f json' 2021-10-14T13:35:09.980 INFO:scrape:1 jobs: ['6442807'] 2021-10-14T13:35:09.980 INFO:scrape:suites: ['fixed-2', 'mode/packaged', 'mon_election/classic', 'msgr/async-v2only', 'orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0', 'start', 'tasks/rados_api_tests}'] 2021-10-14T13:35:09.981 INFO:scrape: 2021-10-14T13:35:09.984 INFO:teuthology.results:Sending results to sewagner@redhat.com: Test Run: swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/ failed: 12 dead: 3 running: 0 waiting: 0 queued: 0 passed: 85 Fail ================================================================= [6442779] orch:cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:19:43 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442779/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442779/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1f74245d616c46428eef15bc9c3372b9 timeout expired in wait_until_healthy [6442790] orch:cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:20:10 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442790/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442790/ sentry: https://sentry.ceph.com/organizations/ceph/?query=21a7d544ced94e388c09953dd4673d03 timeout expired in wait_until_healthy [6442796] orch:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:22:21 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442796/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442796/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c444eb62d0634175a1fad5c1b0e5b807 timeout expired in wait_until_healthy [6442798] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:32:32 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442798/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442798/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8bfa634dbd9f464996ffa3c69a987d50 timeout expired in wait_until_healthy [6442807] orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:11:37 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442807/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442807/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d874d9c46a7448a183511cd453ff17bc Command failed on smithi175 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:c80877c64b21ea0ed140e531c8bff3a0eaab10f3 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 0c983464-2ce9-11ec-8c27-001a4aab830c -- ceph mon dump -f json' [6442810] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:23:37 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442810/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442810/ sentry: https://sentry.ceph.com/organizations/ceph/?query=95c1e87f78b1470d9a1ea27487efa9df timeout expired in wait_until_healthy [6442825] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:34:13 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442825/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442825/ sentry: https://sentry.ceph.com/organizations/ceph/?query=89753101020540128ab1f38dc47f06c0 timeout expired in wait_until_healthy [6442826] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:24:39 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442826/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442826/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea307cd06a094c6aa546ebc17fe5e2b3 timeout expired in wait_until_healthy [6442829] orch:cephadm/smoke/{0-nvme-loop distro/centos_8.2_container_tools_3.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:19:38 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442829/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442829/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e2d995fec366470b9ad91474e430e6b1 timeout expired in wait_until_healthy [6442855] orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} ----------------------------------------------------------------- time: 00:21:44 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442855/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442855/ sentry: https://sentry.ceph.com/organizations/ceph/?query=59b135f59a6447c0be81595e599f1c99 timeout expired in wait_until_healthy [6442859] orch:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:22:14 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442859/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442859/ sentry: https://sentry.ceph.com/organizations/ceph/?query=49449f8ac7c042da8874afdb3ebc9ada timeout expired in wait_until_healthy [6442867] orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:22:09 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442867/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442867/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0073956786743b8bd54fa5fb5797b75 timeout expired in wait_until_healthy Dead ================================================================= [6442799] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442799/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442799/ 'c80877c64b21ea0ed140e531c8bff3a0eaab10f3' not found in repo: git://git.ceph.com/ceph-ci.git! [6442800] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442800/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442800/ 'c80877c64b21ea0ed140e531c8bff3a0eaab10f3' not found in repo: git://git.ceph.com/ceph-ci.git! [6442801] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442801/ log: http://qa-proxy.ceph.com/teuthology/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442801/ 'c80877c64b21ea0ed140e531c8bff3a0eaab10f3' not found in repo: git://git.ceph.com/ceph-ci.git! Pass ================================================================= [6442776] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:34 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442776/ [6442777] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:30:19 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442777/ [6442778] orch:cephadm/orchestrator_cli/{0-random-distro$/{centos_8.3_container_tools_3.0} 2-node-mgr orchestrator_cli} time: 00:14:40 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442778/ [6442780] orch:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:14:24 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442780/ [6442781] orch:cephadm/smoke-singlehost/{0-distro$/{centos_8.2_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:12:03 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442781/ [6442782] orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:35:44 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442782/ [6442783] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} time: 00:30:04 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442783/ [6442784] orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:34:52 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442784/ [6442785] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_adoption} time: 00:09:59 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442785/ [6442786] orch:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:23:38 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442786/ [6442787] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:45:58 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442787/ [6442788] orch:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:13:57 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442788/ [6442789] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:36:16 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442789/ [6442791] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:38:25 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442791/ [6442792] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm} time: 00:16:05 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442792/ [6442793] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:17:56 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442793/ [6442794] orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:48:38 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442794/ [6442795] orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:23:16 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442795/ [6442797] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:19:19 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442797/ [6442802] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:19:37 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442802/ [6442803] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:26:07 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442803/ [6442804] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:32:44 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442804/ [6442805] orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:32:12 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442805/ [6442806] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} time: 00:33:37 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442806/ [6442808] orch:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:17:32 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442808/ [6442809] orch:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:23:26 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442809/ [6442811] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:47:29 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442811/ [6442812] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_nfs} time: 00:23:00 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442812/ [6442813] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:34:26 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442813/ [6442814] orch:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:18:52 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442814/ [6442815] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:30:08 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442815/ [6442816] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:38:24 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442816/ [6442817] orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:37:44 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442817/ [6442818] orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:23:05 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442818/ [6442819] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:18:01 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442819/ [6442820] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:19:11 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442820/ [6442821] orch:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:35:48 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442821/ [6442822] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_orch_cli} time: 00:13:52 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442822/ [6442823] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:33:26 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442823/ [6442824] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:17:46 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442824/ [6442827] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:22:35 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442827/ [6442828] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:59 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442828/ [6442830] orch:cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:17:27 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442830/ [6442831] orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} time: 00:35:56 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442831/ [6442832] orch:cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait mon_election/classic} time: 00:34:08 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442832/ [6442833] orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:35:12 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442833/ [6442834] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_adoption} time: 00:09:50 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442834/ [6442835] orch:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:23:54 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442835/ [6442836] orch:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:32 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442836/ [6442837] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:45:24 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442837/ [6442838] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:34:11 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442838/ [6442839] orch:cephadm/smoke/{0-nvme-loop distro/centos_8.3_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:14:50 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442839/ [6442840] orch:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:14:04 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442840/ [6442841] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:38:09 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442841/ [6442842] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_cephadm} time: 00:16:34 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442842/ [6442843] orch:cephadm/thrash/{0-distro/centos_8.2_container_tools_3.0 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:50:00 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442843/ [6442844] orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:23:00 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442844/ [6442845] orch:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:36:26 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442845/ [6442846] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:17:42 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442846/ [6442847] orch:cephadm/mgr-nfs-upgrade/{0-centos_8.2_container_tools_3.0 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:28:19 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442847/ [6442848] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:34:35 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442848/ [6442849] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:18:11 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442849/ [6442850] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:47:15 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442850/ [6442851] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_cephadm_repos} time: 00:06:52 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442851/ [6442852] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:18:33 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442852/ [6442853] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:26:22 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442853/ [6442854] orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.3_container_tools_3.0 conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:33:10 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442854/ [6442856] orch:cephadm/upgrade/{1-start-distro/1-start-centos_8.3-octopus 2-repo_digest/repo_digest 3-start-upgrade 4-wait mon_election/connectivity} time: 00:28:57 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442856/ [6442857] orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:34:55 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442857/ [6442858] orch:cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:17:20 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442858/ [6442860] orch:cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:19:16 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442860/ [6442861] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:45:39 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442861/ [6442862] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/classic task/test_nfs} time: 00:22:18 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442862/ [6442863] orch:cephadm/smoke-roleless/{0-distro/centos_8.2_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress-rgw 3-final} time: 00:16:03 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442863/ [6442864] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:34:13 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442864/ [6442865] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:38:00 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442865/ [6442866] orch:cephadm/smoke-roleless/{0-distro/centos_8.3_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:43 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442866/ [6442868] orch:cephadm/with-work/{0-distro/centos_8.2_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} time: 00:23:17 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442868/ [6442869] orch:cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:20:20 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442869/ [6442870] orch:cephadm/with-work/{0-distro/centos_8.3_container_tools_3.0 fixed-2 mode/packaged mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:35:42 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442870/ [6442871] orch:cephadm/workunits/{0-distro/centos_8.2_container_tools_3.0 mon_election/connectivity task/test_orch_cli} time: 00:14:10 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442871/ [6442872] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:35:00 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442872/ [6442873] orch:cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:21:13 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442873/ [6442874] orch:cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/connectivity msgr/async start tasks/rados_api_tests} time: 00:46:23 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442874/ [6442875] orch:cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:26:01 info: http://pulpito.ceph.com/swagner-2021-10-14_09:12:37-orch:cephadm-wip-swagner-testing-2021-10-13-1431-distro-basic-smithi/6442875/