2021-01-21T07:23:02.253 INFO:root:teuthology version: 1.0.0-0746baa9 2021-01-21T07:23:02.255 INFO:teuthology.results:subset: '971/9999' 2021-01-21T07:23:02.255 INFO:teuthology.results:seed: '2477' 2021-01-21T08:50:19.838 INFO:root:teuthology version: 1.0.0-0746baa9 2021-01-21T08:50:22.298 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-21T20:48:40.314 INFO:teuthology.results:Tests finished! gathering results... 2021-01-21T20:48:57.397 INFO:scrape:Found 116 jobs 2021-01-21T20:49:07.701 INFO:scrape:Found 8 distinct failure reasons 2021-01-21T20:49:07.703 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2021-01-21T20:49:07.703 INFO:scrape:7 jobs: ['5807153', '5807157', '5807194', '5807181', '5807108', '5807169', '5807189'] 2021-01-21T20:49:07.703 INFO:scrape:suites intersection: [] 2021-01-21T20:49:07.704 INFO:scrape:suites union: ['1-install/nautilus-v2only', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/on', 'distro$/{centos_8.0}', 'distro$/{centos_latest}', 'distro$/{rhel_8.0}', 'distro$/{rhel_latest}', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity}', 'msgr-failures/fastclose', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/cephadm/upgrade/{1-start', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/radosbench}'] 2021-01-21T20:49:07.704 INFO:scrape: 2021-01-21T20:49:07.705 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi110 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' 2021-01-21T20:49:07.705 INFO:scrape:2 jobs: ['5807221', '5807165'] 2021-01-21T20:49:07.706 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2021-01-21T20:49:07.706 INFO:scrape:suites union: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}'] 2021-01-21T20:49:07.707 INFO:scrape: 2021-01-21T20:49:07.707 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi161 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-01-21T20:49:07.707 INFO:scrape:3 jobs: ['5807206', '5807116', '5807164'] 2021-01-21T20:49:07.708 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2021-01-21T20:49:07.708 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2021-01-21T20:49:07.709 INFO:scrape: 2021-01-21T20:49:07.709 INFO:scrape:Dead: b'2021-01-21T19:51:36.078 DEBUG:teuthology.exit:Finished running handlers' 2021-01-21T20:49:07.710 INFO:scrape:8 jobs: ['5807137', '5807152', '5807156', '5807142', '5807199', '5807120', '5807180', '5807211'] 2021-01-21T20:49:07.710 INFO:scrape:suites intersection: [] 2021-01-21T20:49:07.711 INFO:scrape:suites union: ['1-install/nautilus', '1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-partial-recovery}', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04_podman}', 'distro$/{ubuntu_18.04}', 'fast/normal', 'fixed-2', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr-failures/fastclose', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/upgrade/{1-start', 'rados/singleton-nomsgr/{all/msgr', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}}', 'thrashers/default', 'thrashers/mapgap', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/ec-small-objects-many-deletes}', 'workloads/radosbench-high-concurrency}', 'workloads/test_rbd_api}'] 2021-01-21T20:49:07.711 INFO:scrape: 2021-01-21T20:49:07.712 INFO:scrape:Failure: Command failed on smithi075 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid 76ff6852-5bc2-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.75 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' 2021-01-21T20:49:07.712 INFO:scrape:10 jobs: ['5807150', '5807185', '5807188', '5807159', '5807140', '5807176', '5807214', '5807126', '5807129', '5807209'] 2021-01-21T20:49:07.713 INFO:scrape:suites intersection: [] 2021-01-21T20:49:07.713 INFO:scrape:suites union: ['fixed-2', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr/async-v1only', 'msgr/async-v2only', 'rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman', 'rados/cephadm/smoke/{distro/ubuntu_18.04_podman', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'start', 'start}', 'task/test_orch_cli}', 'tasks/rados_python}'] 2021-01-21T20:49:07.714 INFO:scrape: 2021-01-21T20:49:07.714 INFO:scrape:Failure: psutil.NoSuchProcess process no longer exists (pid=13711) 2021-01-21T20:49:07.714 INFO:scrape:1 jobs: ['5807196'] 2021-01-21T20:49:07.715 INFO:scrape:suites: ['1-install/nautilus', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'distro$/{ubuntu_18.04}', 'mon_election/connectivity', 'msgr-failures/few', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}'] 2021-01-21T20:49:07.715 INFO:scrape: 2021-01-21T20:49:07.716 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0' 2021-01-21T20:49:07.716 INFO:scrape:2 jobs: ['5807202', '5807148'] 2021-01-21T20:49:07.717 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/classic', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2021-01-21T20:49:07.717 INFO:scrape:suites union: ['1-install/nautilus-v2only', '1-install/octopus', 'backoff/normal', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/classic', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/careful', 'thrashers/morepggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2021-01-21T20:49:07.718 INFO:scrape: 2021-01-21T20:49:07.718 INFO:scrape:Failure: Command crashed: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_cls_rbd --gtest_filter=-TestClsRbd.get_features:TestClsRbd.parents:TestClsRbd.mirror'" 2021-01-21T20:49:07.719 INFO:scrape:1 jobs: ['5807110'] 2021-01-21T20:49:07.719 INFO:scrape:suites: ['1-install/octopus', 'backoff/normal', 'ceph', 'clusters/{openstack', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'mon_election/classic', 'msgr-failures/few', 'rados', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/morepggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}'] 2021-01-21T20:49:07.720 INFO:scrape: 2021-01-21T20:49:07.724 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/ failed: 24 dead: 10 running: 0 waiting: 0 queued: 0 passed: 82 Fail ================================================================= [5807108] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:17:45 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807108/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807108/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fbb7150181144a32923996dd71cf2169 reached maximum tries (180) after waiting for 180 seconds [5807110] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:35:49 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807110/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807110/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92ddf029eeb641fbacf09a91eccec57d Command crashed: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph_test_cls_rbd --gtest_filter=-TestClsRbd.get_features:TestClsRbd.paren ts:TestClsRbd.mirror'" [5807116] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:07:42 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807116/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807116/ sentry: https://sentry.ceph.com/organizations/ceph/?query=22fffa35ed5a4345b58b29eb720e1cb4 Command failed (workunit test cephadm/test_cephadm.sh) on smithi074 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5807126] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:48 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807126/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807126/ sentry: https://sentry.ceph.com/organizations/ceph/?query=16cb235eef7d4d4597194fe62feff0c1 Command failed on smithi166 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid c67ced2a-5bc0-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.166 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5807129] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:04:59 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807129/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807129/ sentry: https://sentry.ceph.com/organizations/ceph/?query=da9beceae5b14e2e83d51b2bedc51869 Command failed on smithi047 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid b6ede3f2-5bbe-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.47 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5807140] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:05:20 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807140/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807140/ sentry: https://sentry.ceph.com/organizations/ceph/?query=932e226a691b443ebe0d9a56bac8392a Command failed on smithi198 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid 3b4a55ae-5bbf-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.198 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5807148] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:35:33 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807148/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807148/ Command crashed: 'CEPH_CLIENT_ID=2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0' [5807150] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:04:16 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807150/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807150/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8b543d2b8c6e4c0e87706b98bffc0b60 Command failed on smithi075 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid 76ff6852-5bc2-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.75 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5807153] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:16:50 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807153/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807153/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1898c60061a04ad6b4cb55b4d81561b2 reached maximum tries (180) after waiting for 180 seconds [5807159] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:04:54 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807159/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807159/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4045532ff8804dab9fbe2969dc761487 Command failed on smithi097 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid bc26ba52-5bc2-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.97 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5807164] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:07:37 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807164/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807164/ sentry: https://sentry.ceph.com/organizations/ceph/?query=25dc465cb65d4eadafa0bf2a9801c10d Command failed (workunit test cephadm/test_cephadm.sh) on smithi094 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5807165] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:15:27 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807165/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807165/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8d965779d7c04b0e9a63228d6090e70a Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi197 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' [5807169] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:16:33 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807169/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807169/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c93b2c9a37dc42a8b191ca3f8cfb2db4 reached maximum tries (180) after waiting for 180 seconds [5807176] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:06:53 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807176/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807176/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48de153ff39748dc9d35334ad8c258ba Command failed on smithi150 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid b31a3342-5bc4-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.150:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5807181] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:54 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807181/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807181/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d45416ecb0dc4551801b734e14cd2a35 reached maximum tries (180) after waiting for 180 seconds [5807185] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:05:25 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807185/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807185/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dc19b6d4538244aabfd75998e9b705ac Command failed on smithi194 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid e22dbee2-5bc4-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.194 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5807188] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807188/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807188/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eba5d7a3d67c4c928496a9cc06106024 Command failed on smithi029 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid 390d16e0-5bc5-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.29 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5807189] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 01:07:40 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807189/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807189/ sentry: https://sentry.ceph.com/organizations/ceph/?query=281cce6191b2477999be8c930bca9a4a reached maximum tries (500) after waiting for 3000 seconds [5807194] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:18:57 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807194/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807194/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f366a14e39f4f8fb880d5994f7d787e reached maximum tries (180) after waiting for 180 seconds [5807202] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 01:01:37 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807202/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807202/ Command crashed: 'CEPH_CLIENT_ID=2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op write_excl 50 --pool unique_pool_0' [5807206] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:14:02 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807206/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807206/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f273ba0b1bf140ae8de8c03dfa5447e0 Command failed (workunit test cephadm/test_cephadm.sh) on smithi161 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5807209] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:04:17 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807209/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807209/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3a99a53bb10849da9c5f681279a164f7 Command failed on smithi047 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid b297c1d0-5bc6-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.47 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5807214] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807214/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807214/ sentry: https://sentry.ceph.com/organizations/ceph/?query=20c60ab4cefb4606a0c1b1cc5b092788 Command failed on smithi112 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 -v bootstrap --fsid 217c7884-5bc7-11eb-8f93-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.112 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5807221] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:15:14 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807221/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807221/ sentry: https://sentry.ceph.com/organizations/ceph/?query=030715971fcd49bfb0bee9c7caf24cfb Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi110 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d328dbdcd10a95dc57dad0003bc0ec21e01f64e0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh' Dead ================================================================= [5807120] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807120/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807120/ [5807137] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807137/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807137/ [5807142] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807142/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807142/ [5807152] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807152/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807152/ [5807156] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807156/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807156/ [5807157] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807157/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807157/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6b1a3230477431da8b1883ad19913f7 reached maximum tries (60) after waiting for 900 seconds [5807180] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807180/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807180/ [5807196] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 11:34:02 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807196/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807196/ sentry: https://sentry.ceph.com/organizations/ceph/?query=78dab2eed0464661afc99542c8c8ab27 psutil.NoSuchProcess process no longer exists (pid=13711) [5807199] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807199/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807199/ [5807211] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807211/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807211/ Pass ================================================================= [5807106] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:14:29 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807106/ [5807107] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:13:20 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807107/ [5807109] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:59 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807109/ [5807111] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:13:12 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807111/ [5807112] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:14 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807112/ [5807113] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:26:20 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807113/ [5807114] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:12:33 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807114/ [5807115] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} time: 00:31:28 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807115/ [5807117] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:32:37 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807117/ [5807118] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} time: 00:12:10 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807118/ [5807119] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:12:38 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807119/ [5807121] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} time: 00:39:51 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807121/ [5807122] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:18:56 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807122/ [5807123] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:54 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807123/ [5807124] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:36 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807124/ [5807125] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:23 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807125/ [5807127] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} time: 00:19:54 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807127/ [5807128] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:30:06 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807128/ [5807130] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:41 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807130/ [5807131] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:57 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807131/ [5807132] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:31:36 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807132/ [5807133] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:12:04 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807133/ [5807134] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} time: 01:18:19 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807134/ [5807135] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:33:54 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807135/ [5807136] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:13:52 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807136/ [5807138] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:20:45 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807138/ [5807139] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} time: 00:24:08 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807139/ [5807141] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:13:47 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807141/ [5807143] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:21 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807143/ [5807144] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:29 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807144/ [5807145] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:22:22 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807145/ [5807146] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:27:22 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807146/ [5807147] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:21 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807147/ [5807149] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:12:54 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807149/ [5807151] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} time: 05:14:59 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807151/ [5807154] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:36:17 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807154/ [5807155] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:11 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807155/ [5807158] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} time: 00:48:08 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807158/ [5807160] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:59 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807160/ [5807161] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:22:59 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807161/ [5807162] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:57 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807162/ [5807163] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:15:38 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807163/ [5807166] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} time: 00:13:53 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807166/ [5807167] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:29:27 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807167/ [5807168] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:13:06 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807168/ [5807170] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:32:59 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807170/ [5807171] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:20:20 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807171/ [5807172] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} time: 00:13:36 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807172/ [5807173] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:36:30 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807173/ [5807174] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} time: 00:15:37 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807174/ [5807175] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:12:18 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807175/ [5807177] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} time: 00:12:42 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807177/ [5807178] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} time: 00:55:48 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807178/ [5807179] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:19:38 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807179/ [5807182] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:12:48 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807182/ [5807183] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} time: 00:14:17 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807183/ [5807184] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} time: 00:22:41 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807184/ [5807186] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:30:55 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807186/ [5807187] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:25:05 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807187/ [5807190] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} time: 00:12:49 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807190/ [5807191] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:11:50 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807191/ [5807192] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} time: 00:33:49 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807192/ [5807193] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} time: 00:14:06 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807193/ [5807195] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:43:53 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807195/ [5807197] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} time: 00:13:49 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807197/ [5807198] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:11:32 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807198/ [5807200] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} time: 00:25:47 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807200/ [5807201] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} time: 00:48:41 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807201/ [5807203] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:30:23 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807203/ [5807204] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} time: 00:15:19 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807204/ [5807205] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:24:14 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807205/ [5807207] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:19:14 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807207/ [5807208] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} time: 00:12:33 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807208/ [5807210] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} time: 00:34:07 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807210/ [5807212] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:13:03 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807212/ [5807213] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:29:45 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807213/ [5807215] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:28:29 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807215/ [5807216] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:11:40 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807216/ [5807217] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} time: 00:21:37 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807217/ [5807218] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:25:24 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807218/ [5807219] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} time: 00:12:53 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807219/ [5807220] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:15:14 info: http://pulpito.ceph.com/kchai-2021-01-21_07:15:51-rados-wip-kefu-testing-2021-01-21-1119-distro-basic-smithi/5807220/