2021-01-18T20:20:03.634 INFO:root:teuthology version: 1.0.0-04fddc54 2021-01-18T20:20:03.636 INFO:teuthology.results:subset: '971/9999' 2021-01-18T20:20:03.636 INFO:teuthology.results:seed: '2477' 2021-01-19T00:36:36.359 INFO:root:teuthology version: 1.0.0-04fddc54 2021-01-19T00:36:38.736 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-19T12:11:07.482 INFO:teuthology.results:Tests finished! gathering results... 2021-01-19T12:11:56.222 INFO:scrape:Found 446 jobs 2021-01-19T12:12:16.265 INFO:scrape:Found 11 distinct failure reasons 2021-01-19T12:12:16.266 INFO:scrape:Failure: Command failed on smithi039 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 3ebc99be-59d9-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.39 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' 2021-01-19T12:12:16.267 INFO:scrape:81 jobs 2021-01-19T12:12:16.268 INFO:scrape:suites intersection: [] 2021-01-19T12:12:16.268 INFO:scrape:suites union: ['1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus', '1-install/nautilus-v1only', '1-install/nautilus-v2only', '1-install/octopus', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'rados', 'rados/cephadm/dashboard/{distro/centos_latest', 'rados/cephadm/smoke-roleless/{distro/centos_8.0', 'rados/cephadm/smoke-roleless/{distro/centos_latest', 'rados/cephadm/smoke-roleless/{distro/rhel_8.0', 'rados/cephadm/smoke-roleless/{distro/rhel_latest', 'rados/cephadm/smoke-roleless/{distro/ubuntu_18.04', 'rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman', 'rados/cephadm/smoke-roleless/{distro/ubuntu_latest', 'rados/cephadm/smoke/{distro/centos_8.0', 'rados/cephadm/smoke/{distro/centos_latest', 'rados/cephadm/smoke/{distro/rhel_8.0', 'rados/cephadm/smoke/{distro/rhel_latest', 'rados/cephadm/smoke/{distro/ubuntu_18.04', 'rados/cephadm/smoke/{distro/ubuntu_18.04_podman', 'rados/cephadm/smoke/{distro/ubuntu_latest', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/cephadm/with-work/{distro/centos_8.0', 'rados/cephadm/with-work/{distro/centos_latest', 'rados/cephadm/with-work/{distro/rhel_8.0', 'rados/cephadm/with-work/{distro/rhel_latest', 'rados/cephadm/with-work/{distro/ubuntu_18.04', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'start', 'start}', 'task/test_e2e}', 'task/test_orch_cli}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/radosbench}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] 2021-01-19T12:12:16.269 INFO:scrape: 2021-01-19T12:12:16.269 INFO:scrape:Dead: b'2021-01-19T09:57:02.602 DEBUG:teuthology.exit:Finished running handlers' 2021-01-19T12:12:16.270 INFO:scrape:14 jobs: ['5798625', '5798741', '5798605', '5798771', '5798593', '5798836', '5798642', '5798816', '5798747', '5798542', '5798582', '5798555', '5798521', '5798858'] 2021-01-19T12:12:16.270 INFO:scrape:suites intersection: [] 2021-01-19T12:12:16.271 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'cluster/{12-osds', 'clusters/{fixed-2', 'clusters/{fixed-4', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04_podman}', 'distro$/{ubuntu_18.04}', 'fast/normal', 'fixed-2', 'mon_election/classic', 'mon_election/classic}', 'mon_election/connectivity', 'mon_election/connectivity}', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/cephadm/upgrade/{1-start', 'rados/objectstore/{backends/objectstore', 'rados/singleton-nomsgr/{all/msgr', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{rhel_8}}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/default', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/ec-rados-plugin=clay-k=4-m=2}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects-many-deletes}', 'workloads/ec-small-objects-overwrites}', 'workloads/radosbench-high-concurrency}', 'workloads/small-objects}'] 2021-01-19T12:12:16.271 INFO:scrape: 2021-01-19T12:12:16.272 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2021-01-19T12:12:16.272 INFO:scrape:5 jobs: ['5798629', '5798748', '5798472', '5798800', '5798699'] 2021-01-19T12:12:16.273 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'rados/cephadm/upgrade/{1-start'] 2021-01-19T12:12:16.273 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{centos_8.0}', 'distro$/{centos_latest}', 'distro$/{rhel_8.0}', 'distro$/{rhel_latest}', 'fixed-2', 'mon_election/classic}', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] 2021-01-19T12:12:16.274 INFO:scrape: 2021-01-19T12:12:16.274 INFO:scrape:Failure: wait_for_recovery: failed before timeout expired 2021-01-19T12:12:16.274 INFO:scrape:6 jobs: ['5798522', '5798877', '5798691', '5798595', '5798513', '5798499'] 2021-01-19T12:12:16.275 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'mon_election/classic', 'openstack}', 'rados', 'thrashosds-health'] 2021-01-19T12:12:16.275 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'fast/fast', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr/async', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/cache-agent-small}', 'workloads/cache-pool-snaps}', 'workloads/ec-rados-plugin=jerasure-k=2-m=1}', 'workloads/snaps-few-objects}', 'workloads/write_fadvise_dontneed}'] 2021-01-19T12:12:16.276 INFO:scrape: 2021-01-19T12:12:16.276 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi079 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-01-19T12:12:16.277 INFO:scrape:3 jobs: ['5798680', '5798839', '5798507'] 2021-01-19T12:12:16.277 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2021-01-19T12:12:16.277 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2021-01-19T12:12:16.278 INFO:scrape: 2021-01-19T12:12:16.278 INFO:scrape:Failure: Command failed (workunit test cephtool/test.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' 2021-01-19T12:12:16.279 INFO:scrape:1 jobs: ['5798565'] 2021-01-19T12:12:16.279 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/many', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{rhel_8}}'] 2021-01-19T12:12:16.280 INFO:scrape: 2021-01-19T12:12:16.280 INFO:scrape:Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 2021-01-19T12:12:16.280 INFO:scrape:2 jobs: ['5798827', '5798651'] 2021-01-19T12:12:16.281 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'msgr-failures/few', 'msgr/async-v2only', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-01-19T12:12:16.281 INFO:scrape:suites union: ['ceph', 'clusters/{fixed-2', 'd-thrash/none', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'validater/valgrind}'] 2021-01-19T12:12:16.282 INFO:scrape: 2021-01-19T12:12:16.282 INFO:scrape:Failure: Command failed (workunit test mon/mon-bind.sh) on smithi135 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh' 2021-01-19T12:12:16.282 INFO:scrape:1 jobs: ['5798801'] 2021-01-19T12:12:16.283 INFO:scrape:suites: ['rados/standalone/{mon_election/classic', 'supported-random-distro$/{ubuntu_latest}', 'workloads/mon}'] 2021-01-19T12:12:16.283 INFO:scrape: 2021-01-19T12:12:16.284 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi079 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-01-19T12:12:16.284 INFO:scrape:1 jobs: ['5798831'] 2021-01-19T12:12:16.284 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/rados_api_tests}'] 2021-01-19T12:12:16.285 INFO:scrape: 2021-01-19T12:12:16.285 INFO:scrape:Failure: Exiting scrub checking -- not all pgs scrubbed. 2021-01-19T12:12:16.286 INFO:scrape:1 jobs: ['5798539'] 2021-01-19T12:12:16.286 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'mon_election/connectivity', 'msgr-failures/fastclose', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'recovery-overrides/{default}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/pggrow', 'thrashosds-health', 'workloads/ec-rados-plugin=isa-k=2-m=1}'] 2021-01-19T12:12:16.287 INFO:scrape: 2021-01-19T12:12:16.287 INFO:scrape:Failure: psutil.NoSuchProcess process no longer exists (pid=20697) 2021-01-19T12:12:16.287 INFO:scrape:1 jobs: ['5798589'] 2021-01-19T12:12:16.288 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/snaps-few-objects-localized}'] 2021-01-19T12:12:16.288 INFO:scrape: 2021-01-19T12:12:16.303 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/ failed: 101 dead: 15 running: 0 waiting: 0 queued: 0 passed: 330 Fail ================================================================= [5798464] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:46 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798464/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798464/ sentry: https://sentry.ceph.com/organizations/ceph/?query=21013c8222fb4a72891ddbe69f19903b Command failed on smithi145 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid d9572d7a-59cc-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.145 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798467] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} ----------------------------------------------------------------- time: 00:06:44 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798467/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798467/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6797cacce26e454d978045c58c4906bd Command failed on smithi082 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid a656e63a-59cd-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.82 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798472] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:17:01 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798472/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798472/ sentry: https://sentry.ceph.com/organizations/ceph/?query=14e765d652cd4a7e9c3a4226bc15ecc5 reached maximum tries (180) after waiting for 180 seconds [5798484] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:09:18 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798484/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798484/ sentry: https://sentry.ceph.com/organizations/ceph/?query=58249162627240d4bf7021d79bf66094 Command failed on smithi016 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 24f871aa-59d0-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.16 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798487] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:05:25 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798487/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798487/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fe349b6e81604a0b8142e79436047225 Command failed on smithi167 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 747a9196-59cf-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.167 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798494] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:06:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798494/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798494/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6edd8e9d4528470ca270c811be697147 Command failed on smithi028 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 5cb0a964-59d0-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.28 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798497] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:08:18 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798497/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798497/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac542a65e81b4863a3009b2eaab58108 Command failed on smithi051 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 62ee2c3e-59d0-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.51 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798499] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 01:16:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798499/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798499/ wait_for_recovery: failed before timeout expired [5798502] rados/cephadm/smoke-roleless/{distro/centos_latest start} ----------------------------------------------------------------- time: 00:06:36 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798502/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798502/ sentry: https://sentry.ceph.com/organizations/ceph/?query=36a9efa6aefa4205b5baa886ca4e9917 Command failed on smithi049 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 64f5e2c4-59d0-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.49 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798505] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:04:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798505/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798505/ sentry: https://sentry.ceph.com/organizations/ceph/?query=13771ef03d404c7fb1086ca78aaac887 Command failed on smithi082 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 839270a2-59d1-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.82:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798507] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:07:22 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798507/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798507/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7841f0b77fa54ef2a9d14d513240f71c Command failed (workunit test cephadm/test_cephadm.sh) on smithi076 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5798510] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:05:10 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798510/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798510/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72fda26991764f03b808a1f43678ac0e Command failed on smithi096 with status 1: "sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid dccf9808-59d0-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.96:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798513] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-small} ----------------------------------------------------------------- time: 00:53:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798513/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798513/ wait_for_recovery: failed before timeout expired [5798519] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798519/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798519/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ac9b5c12fec0494d8342c240ee950b5f Command failed on smithi203 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 5dc3554e-59d1-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.203 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798522] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps} ----------------------------------------------------------------- time: 01:13:21 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798522/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798522/ wait_for_recovery: failed before timeout expired [5798529] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:04:39 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798529/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798529/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a096ac8c1c8643e3864aad41b2d7923f Command failed on smithi154 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 67105942-59d3-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.154:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798535] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:03:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798535/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798535/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dd481d0d7d864043ac047143a567367a Command failed on smithi055 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 2144ea1e-59d2-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.55 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798537] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:08:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798537/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798537/ sentry: https://sentry.ceph.com/organizations/ceph/?query=38439390636642b99092605c7ce47398 Command failed on smithi118 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 24ca718a-59d3-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.118 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798539] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} ----------------------------------------------------------------- time: 00:38:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798539/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798539/ Exiting scrub checking -- not all pgs scrubbed. [5798541] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:07:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798541/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798541/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f11caba7391d42d3a2bb35e136b3bfd1 Command failed on smithi018 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 6c710fa8-59d3-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.18 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798545] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/careful thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:04:44 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798545/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798545/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f57eaa9df9d54f648ee31b72f4e15d66 Command failed on smithi006 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 8b1ea532-59d3-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.6:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798549] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:16 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798549/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798549/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2146b8411d6346bcafada0cafeb79e7d Command failed on smithi196 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid c618cb0e-59d3-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.196 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798558] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:03:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798558/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798558/ sentry: https://sentry.ceph.com/organizations/ceph/?query=49cf5ed6b67c4d94a0abb9950d376bec Command failed on smithi084 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 0b864fd6-59d4-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.84 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798565] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:25:16 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798565/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798565/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48edd947297645a79feb75fa0e3caada Command failed (workunit test cephtool/test.sh) on smithi119 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' [5798566] rados/cephadm/smoke-roleless/{distro/rhel_latest start} ----------------------------------------------------------------- time: 00:05:37 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798566/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798566/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a6716805cf0440179a478f95ecf93c51 Command failed on smithi002 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 12270c76-59d5-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.2 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798568] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/default thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:04:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798568/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798568/ sentry: https://sentry.ceph.com/organizations/ceph/?query=00b6d472317943cbb2bc029dd27aa0bd Command failed on smithi142 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 87c55d52-59d5-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.142:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798571] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:09:07 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798571/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798571/ sentry: https://sentry.ceph.com/organizations/ceph/?query=63ccd2fdb9a3402daf6bfd5d7714a90c Command failed on smithi069 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 58bbb4ec-59d6-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.69 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798578] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:07:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798578/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798578/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7e8dea5570e04ebaa6767ef76635c507 Command failed on smithi017 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid a119cdae-59d7-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.17 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798586] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/mapgap thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:05:18 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798586/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798586/ sentry: https://sentry.ceph.com/organizations/ceph/?query=08a207d7c60c43dfa4499a9505efe806 Command failed on smithi029 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 7322e8cc-59d7-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.29:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798590] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_orch_cli} ----------------------------------------------------------------- time: 00:05:37 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798590/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798590/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f23f0eb941b045c1b95d7b448067812e Command failed on smithi123 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid ad539f24-59d6-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.123 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798592] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:12 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798592/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798592/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7beecae474f14dbd87096b0d3a4a9757 Command failed on smithi165 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 65625b0a-59d7-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.165 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798595] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed} ----------------------------------------------------------------- time: 01:06:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798595/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798595/ wait_for_recovery: failed before timeout expired [5798597] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} ----------------------------------------------------------------- time: 00:03:31 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798597/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798597/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c8be52d1654b42489cfa9e27dd7b9c27 Command failed on smithi142 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid cffd4976-59d6-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.142 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798603] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:08:44 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798603/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798603/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e972d5ebb9b94159bb85dc5c8b55d218 Command failed on smithi039 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 3ebc99be-59d9-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.39 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798608] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798608/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798608/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e0b3504c997d47f8bf793a19cd4c0325 Command failed on smithi135 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 132cf83e-59d9-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.135 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798614] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:05:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798614/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798614/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4aacda397aa040278302245b383ce9f0 Command failed on smithi139 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid d9eb6f56-59d8-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.139 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798618] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:29 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798618/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798618/ sentry: https://sentry.ceph.com/organizations/ceph/?query=762ed849aafb48968c2e5e9d04134c40 Command failed on smithi186 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 5ab4a238-59d9-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.186 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798620] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:04:39 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798620/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798620/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e75d0fc7be024f85b0071d22bf66be94 Command failed on smithi017 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 0edf4b4c-59d9-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.17 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798626] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/none thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:05:16 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798626/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798626/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2dacac8894354d9ea5c3e2785a6f2edd Command failed on smithi039 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid dc0238ea-59da-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.39 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798629] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:44 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798629/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798629/ sentry: https://sentry.ceph.com/organizations/ceph/?query=22274b4d26074f229c58f0c9e277810c reached maximum tries (180) after waiting for 180 seconds [5798638] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:11:52 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798638/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798638/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e7a62e93290e41418cd49d5a9a3ed8fa Command failed on smithi036 with status 1: "sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid fdcf059c-59db-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.36:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798641] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798641/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798641/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ec3dfdcd7a754e6d99929442874c8c9f Command failed on smithi161 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 57c076e0-59db-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.161 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798648] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:05:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798648/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798648/ sentry: https://sentry.ceph.com/organizations/ceph/?query=48185e301711457487ea00f1a6635d5f Command failed on smithi114 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid ce7e0700-59dd-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.114 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798651] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:39:21 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798651/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798651/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5bce8db4468f47a093f9b3b1b26936f0 Command failed (workunit test rados/test.sh) on smithi077 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5798653] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:21 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798653/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798653/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4639cd120a9c433eb0226bda74b7c51c Command failed on smithi064 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid cd77e1a6-59dc-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.64 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798655] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798655/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798655/ sentry: https://sentry.ceph.com/organizations/ceph/?query=50bc69060e8443528133d17499470c47 Command failed on smithi092 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 7ae7a9e4-59dc-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.92 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798661] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:09:11 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798661/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798661/ sentry: https://sentry.ceph.com/organizations/ceph/?query=207cd208df364757bfd761de0820a13c Command failed on smithi154 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 9a1cfc5a-59dd-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.154 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798664] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798664/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798664/ sentry: https://sentry.ceph.com/organizations/ceph/?query=330df58a8b884f04aebb4561153fc56e Command failed on smithi079 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid bb86cc5a-59dc-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.79 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798668] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:04:49 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798668/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798668/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5fc9ebcbb28741aaa2752fbf918f323c Command failed on smithi076 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 1ec5b924-59de-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.76:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798680] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:10:29 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798680/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798680/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a3e58866335458f8cf2d5d96cf530a4 Command failed (workunit test cephadm/test_cephadm.sh) on smithi079 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5798682] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:08:29 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798682/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798682/ sentry: https://sentry.ceph.com/organizations/ceph/?query=92644b21b75740d4919da5f7dbba6537 Command failed on smithi124 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 13af6c5a-59df-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.124 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798690] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:51 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798690/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798690/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bf6803ce3e774505866ca8f3be796797 Command failed on smithi174 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 6a246202-59df-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.174 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798691] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 01:19:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798691/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798691/ wait_for_recovery: failed before timeout expired [5798694] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} ----------------------------------------------------------------- time: 00:06:44 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798694/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798694/ sentry: https://sentry.ceph.com/organizations/ceph/?query=89f77ad596904b14ace384163bffaf3f Command failed on smithi094 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 272e9f16-59e0-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.94 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798699] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:16:42 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798699/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798699/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8c020cddd044b24be1d1d33add4180f reached maximum tries (180) after waiting for 180 seconds [5798703] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:05:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798703/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798703/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5a61219a785041888510fb884f9f8a16 Command failed on smithi142 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 62406544-59e0-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.142 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798709] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:04:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798709/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798709/ sentry: https://sentry.ceph.com/organizations/ceph/?query=11613f3a40b04b719c1aceb357c446b9 Command failed on smithi174 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid f205b224-59e0-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.174:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798712] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:06:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798712/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798712/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a7e047ec76644b9181a6ac4db21b3dea Command failed on smithi089 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid b7f7fb18-59e1-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.89 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798720] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:04:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798720/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798720/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84f52a1a58c84aff95606210aa06afe5 Command failed on smithi043 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 81b006f4-59e1-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.43:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798726] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:08:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798726/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798726/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0488555fe2c547aab26f33fdf07f5b53 Command failed on smithi112 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 37e34062-59e2-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.112 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798729] rados/cephadm/smoke-roleless/{distro/centos_latest start} ----------------------------------------------------------------- time: 00:06:17 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798729/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798729/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82070d13b9dd4fd7a58a0d49e1f3c19b Command failed on smithi196 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 5d225e74-59e4-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.196 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798733] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:07:07 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798733/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798733/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9c0b13eb04654d6389f96e1fd33e601e Command failed on smithi141 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid f7923aa8-59e2-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.141:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798739] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:35 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798739/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798739/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c325f88d63034293bf1b6c114a5d8150 Command failed on smithi043 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 047b342c-59e3-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.43 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798743] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:04:40 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798743/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798743/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0456fd64ca264b3fb54b12ae83b1b44c Command failed on smithi166 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 39b1ec9e-59e3-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.166:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798748] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:17:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798748/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798748/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ab34e6f10b664c2e9da824e82c0c0204 reached maximum tries (180) after waiting for 180 seconds [5798753] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798753/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798753/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dcd881e1c6ee40baa4f8a1621e5f9f9f Command failed on smithi181 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid ea902670-59e3-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.181 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798756] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:08:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798756/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798756/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4454178e2b504de1942490b2516dba4e Command failed on smithi148 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid b657c272-59e4-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.148 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798760] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:08:59 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798760/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798760/ sentry: https://sentry.ceph.com/organizations/ceph/?query=292699edca124c4cb8d9c91ff4ededee Command failed on smithi180 with status 1: "sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid aa43d06a-59e5-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.180:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798763] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli} ----------------------------------------------------------------- time: 00:05:46 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798763/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798763/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5ed8667fc014fe790d416b5521bbb4d Command failed on smithi115 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid c0bff9fa-59e4-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.115 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798767] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:06:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798767/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798767/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1e4706d22b344b5d87c2bd5e6df93728 Command failed on smithi204 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 16e76b24-59e5-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.204:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798774] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:05:18 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798774/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798774/ sentry: https://sentry.ceph.com/organizations/ceph/?query=461c1df90b34403486ad268133635c4b Command failed on smithi092 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 773157ba-59e5-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.92 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798777] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:05:03 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798777/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798777/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4bc2716381024dedb0059b4596ae494b Command failed on smithi174 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 880004f6-59e5-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.174 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798783] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:03:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798783/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798783/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e29541bfe93946178c815ad4db4f1e9d Command failed on smithi123 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid daec0eda-59e5-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.123 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798788] rados/cephadm/smoke-roleless/{distro/rhel_latest start} ----------------------------------------------------------------- time: 00:05:26 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798788/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798788/ sentry: https://sentry.ceph.com/organizations/ceph/?query=467a722754ac4f84af2b81b02cb6950f Command failed on smithi148 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 59f306a2-59e6-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.148 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798792] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:08:31 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798792/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798792/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a30af20340fd40e8b53ac18248fa72b6 Command failed on smithi193 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 8aee261e-59e7-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.193 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798797] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:06:50 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798797/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798797/ sentry: https://sentry.ceph.com/organizations/ceph/?query=556727bbab574e90b3ae6fa08feb58cf Command failed on smithi203 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 6d858e32-59e7-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.203 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798800] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:19:47 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798800/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798800/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e091803f7d7e49c198ae6d09ab1591b5 reached maximum tries (180) after waiting for 180 seconds [5798801] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mon} ----------------------------------------------------------------- time: 00:58:31 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798801/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798801/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fd84425604ab4ca680bd86f8fb2e2dd4 Command failed (workunit test mon/mon-bind.sh) on smithi135 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/mon-bind.sh' [5798810] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/pggrow thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:05:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798810/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798810/ sentry: https://sentry.ceph.com/organizations/ceph/?query=1be151e494494b38adfb00538a109bf4 Command failed on smithi006 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 757a530c-59e7-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.6 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798812] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:06:10 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798812/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798812/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a9bd221681c7452693fd5449c573b99f Command failed on smithi146 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 482add76-59e8-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.146 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798815] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} ----------------------------------------------------------------- time: 00:03:22 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798815/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798815/ sentry: https://sentry.ceph.com/organizations/ceph/?query=80f97ccd28f9458b86d026ad485049e5 Command failed on smithi036 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid d8c8306e-59e7-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.36 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798819] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_python} ----------------------------------------------------------------- time: 00:11:25 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798819/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798819/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79360fa8684743ce9028a5cc76c6170e Command failed on smithi124 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 25d28ef8-59e9-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.124 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798827] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 06:40:01 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798827/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798827/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3f70f964215746398aa6416ff1250e59 Command failed (workunit test rados/test.sh) on smithi194 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust- ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5798829] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:05:30 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798829/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798829/ sentry: https://sentry.ceph.com/organizations/ceph/?query=dbe82fcbfb004961b31cbd0eb1a6c85a Command failed on smithi123 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 368abd56-59e9-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.123 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798831] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} ----------------------------------------------------------------- time: 00:41:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798831/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798831/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c0e8bef4f0854c298b06d482638bb118 Command failed (workunit test rados/test.sh) on smithi079 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [5798832] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:08:14 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798832/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798832/ sentry: https://sentry.ceph.com/organizations/ceph/?query=395ee15e8ccc465e964ddd9cafda67e0 Command failed on smithi067 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid dd86160a-59e9-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.67 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798839] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:12:38 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798839/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798839/ sentry: https://sentry.ceph.com/organizations/ceph/?query=06aa036a4ec048aeb7420416c555584a Command failed (workunit test cephadm/test_cephadm.sh) on smithi174 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6e4624ca633e07ffbd99444977fe61a222642d99 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5798841] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/default thrashosds-health workloads/test_rbd_api} ----------------------------------------------------------------- time: 00:04:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798841/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798841/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ba4847237b704faba91b09395e9f3c9f Command failed on smithi026 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 529515d6-59ea-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.26:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798845] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798845/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798845/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6f25c715c78d453aaa960268c0742a23 Command failed on smithi200 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid a5018822-59ea-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.200 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798850] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} ----------------------------------------------------------------- time: 00:04:39 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798850/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798850/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4f0ff7fc9dbe4829abd4cb07929b508e Command failed on smithi136 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid cc55143e-59ea-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.136 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798852] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} ----------------------------------------------------------------- time: 00:09:28 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798852/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798852/ sentry: https://sentry.ceph.com/organizations/ceph/?query=60585d0e7be540aeb899723a89c6a29e Command failed on smithi049 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 6f556274-59eb-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.49:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798862] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:17 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798862/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798862/ sentry: https://sentry.ceph.com/organizations/ceph/?query=95863311eea943dd90cb6c28db3bcf9c Command failed on smithi115 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid bcc88b08-59eb-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.115 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798866] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/mapgap thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:04:36 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798866/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798866/ sentry: https://sentry.ceph.com/organizations/ceph/?query=84eeb5c12a6c4f528af69713d4267424 Command failed on smithi071 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 310022ce-59ec-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.71:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798872] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start} ----------------------------------------------------------------- time: 00:05:23 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798872/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798872/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea6bb54437d140e484700d3ee5281e19 Command failed on smithi049 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid f927a4fc-59ec-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.49 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798877] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} ----------------------------------------------------------------- time: 01:22:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798877/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798877/ wait_for_recovery: failed before timeout expired [5798878] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} ----------------------------------------------------------------- time: 00:03:16 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798878/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798878/ sentry: https://sentry.ceph.com/organizations/ceph/?query=76235b0e0f0247a59cb5e873abeaf1a2 Command failed on smithi141 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 2b1bf94a-59ed-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.141 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798880] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:05:03 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798880/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798880/ sentry: https://sentry.ceph.com/organizations/ceph/?query=493109a6b8c84c82bf7fa456405c1204 Command failed on smithi203 with status 1: 'sudo cephadm --image quay.ceph.io/ceph-ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 6c69ffb4-59ed-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.203 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798889] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/morepggrow thrashosds-health workloads/radosbench} ----------------------------------------------------------------- time: 00:04:56 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798889/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798889/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f19f18b4e36442ee89a0ac20f4de48ea Command failed on smithi112 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid edcb3186-59ed-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.112:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798893] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:03:21 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798893/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798893/ sentry: https://sentry.ceph.com/organizations/ceph/?query=99b8129d581b48a789910864b9faac3a Command failed on smithi142 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 0b858e7e-59ee-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.142 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' [5798901] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/none thrashosds-health workloads/rbd_cls} ----------------------------------------------------------------- time: 00:04:49 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798901/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798901/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a1628fccd61e4166934af705994c0500 Command failed on smithi049 with status 1: "sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid dafecc1a-59ee-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial- daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.49:6789]' && sudo chmod +r /etc/ceph/ceph.client.admin.keyring" [5798904] rados/cephadm/dashboard/{distro/centos_latest task/test_e2e} ----------------------------------------------------------------- time: 00:08:31 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798904/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798904/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c72e4798adf24d4fa7c2b0ead096747b Command failed on smithi155 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:6e4624ca633e07ffbd99444977fe61a222642d99 -v bootstrap --fsid 54d9f59a-59f0-11eb-8f90-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id a --orphan-initial- daemons --skip-monitoring-stack --mon-ip 172.21.15.155 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring' Dead ================================================================= [5798521] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798521/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798521/ [5798542] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-overwrites} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798542/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798542/ [5798555] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798555/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798555/ [5798582] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/classic} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798582/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798582/ [5798589] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized} ----------------------------------------------------------------- time: 11:53:49 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798589/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798589/ psutil.NoSuchProcess process no longer exists (pid=20697) [5798593] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798593/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798593/ [5798605] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798605/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798605/ [5798625] rados/objectstore/{backends/objectstore supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798625/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798625/ [5798642] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798642/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798642/ [5798741] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench-high-concurrency} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798741/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798741/ [5798747] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798747/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798747/ [5798771] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/small-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798771/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798771/ [5798816] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798816/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798816/ [5798836] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798836/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798836/ [5798858] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798858/ log: http://qa-proxy.ceph.com/teuthology/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798858/ Pass ================================================================= [5798463] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798463/ [5798465] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/redirect_promote_tests} time: 00:16:09 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798465/ [5798466] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_set_object} time: 00:15:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798466/ [5798468] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:21 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798468/ [5798469] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:11 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798469/ [5798470] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/set-chunks-read} time: 00:13:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798470/ [5798471] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:10 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798471/ [5798473] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798473/ [5798474] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind} time: 00:27:25 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798474/ [5798475] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:11:35 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798475/ [5798476] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:09:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798476/ [5798477] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798477/ [5798478] rados/objectstore/{backends/fusestore supported-random-distro$/{centos_8}} time: 00:08:10 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798478/ [5798479] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:11 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798479/ [5798480] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-balanced} time: 00:19:56 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798480/ [5798481] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:26:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798481/ [5798482] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_adoption} time: 00:09:03 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798482/ [5798483] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-localized} time: 00:25:29 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798483/ [5798485] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/erasure-code} time: 00:40:07 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798485/ [5798486] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects} time: 00:21:39 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798486/ [5798488] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_5925} time: 00:10:58 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798488/ [5798489] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:14:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798489/ [5798490] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:28:56 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798490/ [5798491] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/repair_test} time: 00:17:09 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798491/ [5798492] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:47 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798492/ [5798493] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:10 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798493/ [5798495] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798495/ [5798496] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-localized} time: 00:26:29 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798496/ [5798498] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:09 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798498/ [5798500] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:10:26 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798500/ [5798501] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:52 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798501/ [5798503] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/write_fadvise_dontneed} time: 00:10:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798503/ [5798504] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:08:37 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798504/ [5798506] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:38:36 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798506/ [5798508] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-big} time: 00:28:36 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798508/ [5798509] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:25:17 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798509/ [5798511] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:08:18 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798511/ [5798512] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/mgr} time: 00:08:51 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798512/ [5798514] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798514/ [5798515] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:04:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798515/ [5798516] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/insights} time: 00:13:22 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798516/ [5798517] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:31:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798517/ [5798518] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep} time: 00:25:23 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798518/ [5798520] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:26:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798520/ [5798523] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798523/ [5798524] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:10:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798524/ [5798525] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:08:50 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798525/ [5798526] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:20 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798526/ [5798527] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_8}} time: 00:13:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798527/ [5798528] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:20:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798528/ [5798530] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-snaps-balanced} time: 00:19:27 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798530/ [5798531] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798531/ [5798532] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_api_tests} time: 00:27:52 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798532/ [5798533] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798533/ [5798534] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:26:04 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798534/ [5798536] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache} time: 00:12:14 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798536/ [5798538] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:18:08 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798538/ [5798540] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:29 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798540/ [5798543] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:22 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798543/ [5798544] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/rados_api_tests} time: 00:28:08 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798544/ [5798546] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/misc} time: 00:30:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798546/ [5798547] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency} time: 01:03:31 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798547/ [5798548] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:09:38 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798548/ [5798550] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:37 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798550/ [5798551] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/radosbench} time: 01:42:06 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798551/ [5798552] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:07:53 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798552/ [5798553] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm_repos} time: 00:06:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798553/ [5798554] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:56 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798554/ [5798556] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/redirect} time: 00:11:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798556/ [5798557] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:11:40 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798557/ [5798559] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:28:39 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798559/ [5798560] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests} time: 00:10:14 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798560/ [5798561] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:09:35 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798561/ [5798562] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:40 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798562/ [5798563] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind} time: 02:09:52 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798563/ [5798564] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_api_tests} time: 00:23:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798564/ [5798567] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object} time: 00:13:07 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798567/ [5798569] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/set-chunks-read} time: 00:19:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798569/ [5798570] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:10:49 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798570/ [5798572] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced} time: 00:18:11 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798572/ [5798573] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/many workloads/rados_mon_osdmap_prune} time: 00:54:37 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798573/ [5798574] rados/singleton/{all/pg-autoscaler mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:12:44 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798574/ [5798575] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:24:04 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798575/ [5798576] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{centos_8} tasks/dashboard} time: 01:07:49 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798576/ [5798577] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:24:12 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798577/ [5798579] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/small-objects-localized} time: 00:19:37 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798579/ [5798580] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mon} time: 00:41:48 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798580/ [5798581] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:28 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798581/ [5798583] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects} time: 00:26:14 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798583/ [5798584] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:56 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798584/ [5798585] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:58 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798585/ [5798587] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced} time: 00:32:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798587/ [5798588] rados/singleton/{all/pg-removal-interruption mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:05:26 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798588/ [5798591] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects} time: 00:27:37 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798591/ [5798594] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:50 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798594/ [5798596] rados/singleton/{all/radostool mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:11:26 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798596/ [5798598] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:16:20 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798598/ [5798599] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:05:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798599/ [5798600] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798600/ [5798601] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests} time: 00:20:07 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798601/ [5798602] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/progress} time: 00:18:49 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798602/ [5798604] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:09 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798604/ [5798606] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep} time: 00:12:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798606/ [5798607] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache-agent-big} time: 00:22:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798607/ [5798609] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:28:51 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798609/ [5798610] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:20:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798610/ [5798611] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/osd} time: 03:14:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798611/ [5798612] rados/singleton/{all/random-eio mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:17:55 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798612/ [5798613] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-agent-small} time: 00:11:40 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798613/ [5798615] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798615/ [5798616] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_workunits} time: 00:29:03 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798616/ [5798617] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 03:09:59 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798617/ [5798619] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps} time: 00:25:26 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798619/ [5798621] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798621/ [5798622] rados/singleton/{all/rebuild-mondb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:13:23 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798622/ [5798623] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced} time: 00:24:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798623/ [5798624] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798624/ [5798627] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:22 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798627/ [5798628] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-snaps} time: 00:21:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798628/ [5798630] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/cache} time: 00:13:17 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798630/ [5798631] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:09:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798631/ [5798632] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_adoption} time: 00:09:25 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798632/ [5798633] rados/singleton/{all/recovery-preemption mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:19:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798633/ [5798634] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects} time: 00:29:38 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798634/ [5798635] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:29 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798635/ [5798636] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_python} time: 00:15:29 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798636/ [5798637] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:14:11 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798637/ [5798639] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/rados_api_tests} time: 00:27:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798639/ [5798640] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/scrub} time: 01:51:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798640/ [5798643] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:12:14 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798643/ [5798644] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:08:46 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798644/ [5798645] rados/singleton/{all/resolve_stuck_peering mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:09:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798645/ [5798646] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:29:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798646/ [5798647] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:14:38 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798647/ [5798649] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:04:31 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798649/ [5798650] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:12:12 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798650/ [5798652] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect} time: 00:12:01 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798652/ [5798654] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests} time: 00:14:44 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798654/ [5798656] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/snaps-few-objects} time: 00:29:55 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798656/ [5798657] rados/singleton/{all/test-crash mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:08 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798657/ [5798658] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:23:10 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798658/ [5798659] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/redirect_set_object} time: 00:13:58 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798659/ [5798660] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:48 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798660/ [5798662] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:23 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798662/ [5798663] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/set-chunks-read} time: 00:17:59 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798663/ [5798665] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:32:11 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798665/ [5798666] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-balanced} time: 00:22:26 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798666/ [5798667] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:29:08 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798667/ [5798669] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:17:47 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798669/ [5798670] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/small-objects-localized} time: 00:23:49 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798670/ [5798671] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} tasks/rados_stress_watch} time: 00:17:32 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798671/ [5798672] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:51 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798672/ [5798673] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:09:54 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798673/ [5798674] rados/rest/{mgr-restful supported-random-distro$/{centos_8}} time: 00:10:21 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798674/ [5798675] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:28:37 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798675/ [5798676] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798676/ [5798677] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/crush} time: 00:12:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798677/ [5798678] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} time: 05:29:06 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798678/ [5798679] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:20:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798679/ [5798681] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/small-objects} time: 00:20:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798681/ [5798683] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:46 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798683/ [5798684] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:46 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798684/ [5798685] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:09:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798685/ [5798686] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 01:25:36 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798686/ [5798687] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/snaps-few-objects-localized} time: 00:27:06 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798687/ [5798688] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:10:38 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798688/ [5798689] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/workunits} time: 00:10:11 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798689/ [5798692] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:10:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798692/ [5798693] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:18:32 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798693/ [5798695] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:30:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798695/ [5798696] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/lockdep} time: 00:19:46 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798696/ [5798697] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:16 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798697/ [5798698] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:40:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798698/ [5798700] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests} time: 00:41:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798700/ [5798701] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:06:39 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798701/ [5798702] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:08 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798702/ [5798704] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-big} time: 00:20:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798704/ [5798705] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/sync workloads/pool-create-delete} time: 00:17:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798705/ [5798706] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:22:53 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798706/ [5798707] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/erasure-code} time: 00:37:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798707/ [5798708] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-agent-small} time: 00:15:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798708/ [5798710] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:21:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798710/ [5798711] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:26:51 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798711/ [5798713] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/rados_striper} time: 00:09:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798713/ [5798714] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:01 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798714/ [5798715] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:42 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798715/ [5798716] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps} time: 00:23:59 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798716/ [5798717] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos} time: 00:06:21 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798717/ [5798718] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced} time: 00:22:12 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798718/ [5798719] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:25:46 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798719/ [5798721] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:16:55 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798721/ [5798722] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798722/ [5798723] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps} time: 00:26:56 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798723/ [5798724] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798724/ [5798725] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}} time: 00:13:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798725/ [5798727] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:04:42 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798727/ [5798728] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache} time: 00:11:17 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798728/ [5798730] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/crash} time: 00:11:20 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798730/ [5798731] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/pool-snaps-few-objects} time: 00:30:44 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798731/ [5798732] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:18:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798732/ [5798734] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:08:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798734/ [5798735] rados/multimon/{clusters/6 mon_election/connectivity msgr-failures/few msgr/async no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:48 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798735/ [5798736] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/rados_api_tests} time: 00:27:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798736/ [5798737] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:07:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798737/ [5798738] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/valgrind} time: 00:27:28 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798738/ [5798740] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/mgr} time: 00:12:21 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798740/ [5798742] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:03 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798742/ [5798744] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/radosbench} time: 01:57:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798744/ [5798745] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_5925} time: 00:10:58 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798745/ [5798746] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:08:49 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798746/ [5798749] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:54 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798749/ [5798750] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect} time: 00:10:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798750/ [5798751] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big} time: 00:31:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798751/ [5798752] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:26 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798752/ [5798754] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/redirect_promote_tests} time: 00:08:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798754/ [5798755] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798755/ [5798757] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/redirect_set_object} time: 00:13:37 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798757/ [5798758] rados/singleton/{all/deduptool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:05:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798758/ [5798759] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:36 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798759/ [5798761] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:16:56 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798761/ [5798762] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:09 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798762/ [5798764] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:25:48 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798764/ [5798765] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:10:32 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798765/ [5798766] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:23:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798766/ [5798768] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/misc} time: 00:26:57 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798768/ [5798769] rados/singleton/{all/divergent_priors mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:06:58 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798769/ [5798770] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/failover} time: 00:13:31 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798770/ [5798772] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:07:56 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798772/ [5798773] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:05:11 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798773/ [5798775] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:11:08 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798775/ [5798776] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:24:04 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798776/ [5798778] rados/multimon/{clusters/9 mon_election/classic msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:13 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798778/ [5798779] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:58 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798779/ [5798780] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:32:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798780/ [5798781] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:17 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798781/ [5798782] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep} time: 00:11:47 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798782/ [5798784] rados/singleton/{all/divergent_priors2 mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:10:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798784/ [5798785] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:29:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798785/ [5798786] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix} time: 00:21:40 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798786/ [5798787] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:32:03 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798787/ [5798789] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_api_tests} time: 00:30:57 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798789/ [5798790] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:22:59 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798790/ [5798791] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:11:23 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798791/ [5798793] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798793/ [5798794] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:40:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798794/ [5798795] rados/singleton/{all/dump-stuck mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8}} time: 00:10:54 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798795/ [5798796] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:25:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798796/ [5798798] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:20:58 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798798/ [5798799] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:08:18 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798799/ [5798802] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:11:38 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798802/ [5798803] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798803/ [5798804] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:08:04 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798804/ [5798805] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:03 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798805/ [5798806] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption} time: 00:08:14 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798806/ [5798807] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:44 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798807/ [5798808] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:32:10 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798808/ [5798809] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:58:25 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798809/ [5798811] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:32:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798811/ [5798813] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:25:52 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798813/ [5798814] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/insights} time: 00:14:08 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798814/ [5798817] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:28:21 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798817/ [5798818] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:08:39 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798818/ [5798820] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:12:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798820/ [5798821] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:33:20 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798821/ [5798822] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:07:27 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798822/ [5798823] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{ubuntu_latest}} time: 02:21:43 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798823/ [5798824] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:20:27 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798824/ [5798825] rados/multimon/{clusters/21 mon_election/connectivity msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:18:22 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798825/ [5798826] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:28:04 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798826/ [5798828] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:24:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798828/ [5798830] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:11:01 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798830/ [5798833] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:20:42 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798833/ [5798834] rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 00:55:18 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798834/ [5798835] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8}} time: 00:50:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798835/ [5798837] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/osd} time: 03:14:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798837/ [5798838] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:32:49 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798838/ [5798840] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/radosbench} time: 02:28:19 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798840/ [5798842] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:14:31 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798842/ [5798843] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:00:04 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798843/ [5798844] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:18:46 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798844/ [5798846] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:25 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798846/ [5798847] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:16 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798847/ [5798848] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:15:39 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798848/ [5798849] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:08:20 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798849/ [5798851] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:13:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798851/ [5798853] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:16:41 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798853/ [5798854] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:05:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798854/ [5798855] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:38 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798855/ [5798856] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/module_selftest} time: 00:28:45 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798856/ [5798857] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:09:23 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798857/ [5798859] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:29:42 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798859/ [5798860] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/readwrite} time: 00:12:53 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798860/ [5798861] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:21:57 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798861/ [5798863] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:23:27 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798863/ [5798864] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:48:52 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798864/ [5798865] rados/multimon/{clusters/3 mon_election/classic msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:08:47 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798865/ [5798867] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:18:18 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798867/ [5798868] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:09:34 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798868/ [5798869] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:14 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798869/ [5798870] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep} time: 00:18:28 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798870/ [5798871] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:30:11 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798871/ [5798873] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard} time: 01:09:55 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798873/ [5798874] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_8}} time: 02:27:33 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798874/ [5798875] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:27:20 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798875/ [5798876] rados/monthrash/{ceph clusters/3-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_workunits} time: 00:28:01 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798876/ [5798879] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:24:20 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798879/ [5798881] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:30:09 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798881/ [5798882] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:09:08 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798882/ [5798883] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:32 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798883/ [5798884] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:18:02 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798884/ [5798885] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos} time: 00:03:52 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798885/ [5798886] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:10:10 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798886/ [5798887] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:28 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798887/ [5798888] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:38:32 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798888/ [5798890] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:28:14 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798890/ [5798891] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:09 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798891/ [5798892] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 00:23:00 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798892/ [5798894] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:17:09 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798894/ [5798895] rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard} time: 01:11:39 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798895/ [5798896] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:32:07 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798896/ [5798897] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:31 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798897/ [5798898] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/crush} time: 00:08:50 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798898/ [5798899] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} time: 05:06:15 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798899/ [5798900] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:13:05 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798900/ [5798902] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/progress} time: 00:23:23 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798902/ [5798903] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:18:50 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798903/ [5798905] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:10:50 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798905/ [5798906] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:29:20 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798906/ [5798907] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_8}} time: 00:13:24 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798907/ [5798908] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:20:08 info: http://pulpito.ceph.com/kchai-2021-01-18_08:15:07-rados-wip-kefu-testing-2021-01-18-1403-distro-basic-smithi/5798908/