2020-04-26T09:26:32.850 INFO:root:teuthology version: 1.0.0-6cf40593 2020-04-26T09:26:32.853 INFO:teuthology.results:subset: '812/9999' 2020-04-26T09:26:32.853 INFO:teuthology.results:seed: '2477' 2020-04-26T11:31:07.095 INFO:root:teuthology version: 1.0.0-6cf40593 2020-04-26T11:31:07.115 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-04-26T12:58:09.950 INFO:teuthology.results:Tests finished! gathering results... 2020-04-26T12:58:10.439 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/ failed: 142 dead: 7 running: 0 waiting: 0 queued: 0 passed: 180 Fail ================================================================= [4986378] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 01:17:09 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986378/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986378/ "2020-04-26T09:47:41.950635+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986380] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/set-chunk-promote-flush.yaml} ----------------------------------------------------------------- time: 00:14:37 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986380/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986380/ "2020-04-26T09:45:03.096108+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986381] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-hybrid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:25:35 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986381/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986381/ "2020-04-26T09:47:35.318846+0000 mgr.y (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986384] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_8.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} ----------------------------------------------------------------- time: 00:20:51 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986384/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986384/ "2020-04-26T09:47:50.280473+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986385] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:11:47 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986385/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986385/ "2020-04-26T09:56:00.032702+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986387] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} ----------------------------------------------------------------- time: 00:15:37 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986387/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986387/ "2020-04-26T09:54:05.348778+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986390] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:22:57 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986390/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986390/ "2020-04-26T09:45:18.473927+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986392] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{centos_8.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 01:07:36 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986392/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986392/ "2020-04-26T09:48:47.215126+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986396] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/small-objects-balanced.yaml} ----------------------------------------------------------------- time: 00:26:43 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986396/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986396/ "2020-04-26T09:49:16.757060+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986397] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{centos_8.yaml} tasks/prometheus.yaml} ----------------------------------------------------------------- time: 00:11:51 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986397/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986397/ "2020-04-26T09:46:58.306356+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986402] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects-localized.yaml} ----------------------------------------------------------------- time: 00:20:45 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986402/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986402/ "2020-04-26T09:48:41.052162+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986407] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects.yaml} ----------------------------------------------------------------- time: 00:22:44 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986407/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986407/ "2020-04-26T10:04:37.933734+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986409] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986409/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986409/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d884d7389f654e0e8f1c70685f0a15f6 Command failed on smithi085 with status 1: 'sudo yum install -y kernel' [4986414] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:15:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986414/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986414/ "2020-04-26T10:23:45.743894+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986416] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} ----------------------------------------------------------------- time: 00:31:12 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986416/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986416/ Command failed on smithi172 with status 125: 'sudo docker kill -s Signals.SIGHUP ceph-d5e013e4-87a6-11ea-a068-001a4aab830c-osd.7' [4986417] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/snaps-few-objects-balanced.yaml} ----------------------------------------------------------------- time: 00:26:54 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986417/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986417/ "2020-04-26T10:00:04.211218+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986419] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-rados-plugin=clay-k=4-m=2.yaml} ----------------------------------------------------------------- time: 00:27:39 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986419/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986419/ "2020-04-26T10:03:27.783954+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986424] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects-localized.yaml} ----------------------------------------------------------------- time: 00:30:04 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986424/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986424/ "2020-04-26T10:04:20.772923+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986425] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_8.yaml} tasks/workunits.yaml} ----------------------------------------------------------------- time: 00:12:13 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986425/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986425/ "2020-04-26T10:06:25.540918+0000 mgr.z (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986427] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{centos_8.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 01:07:16 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986427/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986427/ "2020-04-26T10:04:52.625929+0000 mgr.z (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986429] rados/valgrind-leaks/{1-start.yaml 2-inject-leak/none.yaml centos_latest.yaml} ----------------------------------------------------------------- time: 00:18:03 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986429/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986429/ "2020-04-26T10:07:59.893376+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986430] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} ----------------------------------------------------------------- time: 00:26:41 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986430/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986430/ "2020-04-26T10:07:07.974631+0000 mgr.x (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986432] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} ----------------------------------------------------------------- time: 00:33:29 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986432/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986432/ "2020-04-26T10:05:08.030116+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986438] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} ----------------------------------------------------------------- time: 00:29:56 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986438/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986438/ "2020-04-26T10:08:22.377885+0000 mgr.x (mgr.7299) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986440] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} ----------------------------------------------------------------- time: 00:17:34 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986440/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986440/ "2020-04-26T10:12:14.514124+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986441] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/radosbench.yaml} ----------------------------------------------------------------- time: 01:26:52 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986441/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986441/ Command failed on smithi153 with status 125: 'sudo docker kill -s Signals.SIGHUP ceph-adaf38ae-87a7-11ea-a068-001a4aab830c-osd.5' [4986444] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:44:06 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986444/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986444/ "2020-04-26T10:20:11.649859+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986446] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_python.yaml} ----------------------------------------------------------------- time: 00:14:19 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986446/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986446/ "2020-04-26T10:12:45.328274+0000 mgr.y (mgr.4116) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986447] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-hybrid.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:15:15 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986447/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986447/ "2020-04-26T11:27:11.958378+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986448] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:24:26 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986448/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986448/ "2020-04-26T10:13:33.699705+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986451] rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml} ----------------------------------------------------------------- time: 00:09:11 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986451/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986451/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ec3268e40b5649089c3efcf9c60ddc4e Command failed (workunit test cephadm/test_cephadm.sh) on smithi162 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4a4147f663046b7be09a84aadbd148aa1416133d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [4986452] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:26:51 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986452/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986452/ "2020-04-26T10:07:55.013929+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986455] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} ----------------------------------------------------------------- time: 00:18:46 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986455/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986455/ "2020-04-26T10:08:57.256184+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986457] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_8.yaml} tasks/crash.yaml} ----------------------------------------------------------------- time: 00:14:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986457/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986457/ "2020-04-26T10:14:02.586151+0000 mgr.z (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986461] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} ----------------------------------------------------------------- time: 00:15:27 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986461/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986461/ "2020-04-26T10:17:39.327574+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986463] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{centos_8.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 01:05:50 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986463/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986463/ "2020-04-26T10:15:09.816148+0000 mgr.z (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986465] rados/multimon/{clusters/6.yaml msgr-failures/many.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} tasks/mon_clock_with_skews.yaml} ----------------------------------------------------------------- time: 00:10:43 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986465/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986465/ "2020-04-26T10:15:45.042142+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986466] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/octopus.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} ----------------------------------------------------------------- time: 00:20:06 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986466/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986466/ Command failed on smithi171 with status 125: 'sudo docker kill -s Signals.SIGHUP ceph-8d3606b6-87a7-11ea-a068-001a4aab830c-osd.1' [4986468] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/many.yaml workloads/rados_mon_osdmap_prune.yaml} ----------------------------------------------------------------- time: 00:55:25 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986468/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986468/ "2020-04-26T10:15:05.760065+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986470] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} ----------------------------------------------------------------- time: 00:28:11 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986470/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986470/ "2020-04-26T10:20:14.363391+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986471] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_stress_watch.yaml} ----------------------------------------------------------------- time: 00:16:23 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986471/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986471/ "2020-04-26T10:17:24.053091+0000 mgr.y (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986475] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml tasks/rados_cls_all.yaml validater/lockdep.yaml} ----------------------------------------------------------------- time: 00:14:31 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986475/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986475/ "2020-04-26T10:17:08.490373+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986476] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} ----------------------------------------------------------------- time: 00:29:05 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986476/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986476/ "2020-04-26T10:17:56.500533+0000 mgr.x (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986480] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} ----------------------------------------------------------------- time: 00:28:37 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986480/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986480/ "2020-04-26T10:30:19.047238+0000 mgr.x (mgr.4119) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986482] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:25:56 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986482/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986482/ "2020-04-26T10:17:41.072175+0000 mgr.y (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986483] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml} ----------------------------------------------------------------- time: 00:29:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986483/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986483/ "2020-04-26T10:31:48.224267+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986485] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-snaps-balanced.yaml} ----------------------------------------------------------------- time: 00:23:46 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986485/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986485/ "2020-04-26T10:30:11.198031+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986487] rados/cephadm/orchestrator_cli/{2-node-mgr.yaml orchestrator_cli.yaml supported-random-distro$/{rhel_8.yaml}} ----------------------------------------------------------------- time: 00:16:11 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986487/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986487/ "2020-04-26T10:23:54.485322+0000 mgr.z (mgr.4111) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986488] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_8.yaml} tasks/failover.yaml} ----------------------------------------------------------------- time: 00:13:20 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986488/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986488/ "2020-04-26T10:22:08.828633+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986489] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/hammer.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} ----------------------------------------------------------------- time: 00:50:20 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986489/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986489/ Command failed on smithi069 with status 125: 'sudo docker kill -s Signals.SIGHUP ceph-1655c476-87a9-11ea-a068-001a4aab830c-osd.10' [4986490] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} ----------------------------------------------------------------- time: 00:23:19 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986490/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986490/ "2020-04-26T10:20:49.733255+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986495] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_striper.yaml} ----------------------------------------------------------------- time: 00:08:43 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986495/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986495/ "2020-04-26T10:33:40.758037+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986498] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache.yaml} ----------------------------------------------------------------- time: 00:12:39 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986498/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986498/ "2020-04-26T10:29:34.185546+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986500] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{centos_8.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 01:05:45 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986500/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986500/ "2020-04-26T10:31:23.174735+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986504] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:11:54 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986504/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986504/ "2020-04-26T10:30:08.752379+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986507] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml tasks/mon_recovery.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:26:17 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986507/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986507/ "2020-04-26T10:58:02.207850+0000 mgr.x (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986508] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/dedup_tier.yaml} ----------------------------------------------------------------- time: 00:11:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986508/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986508/ "2020-04-26T10:40:59.710144+0000 mgr.x (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986511] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} ----------------------------------------------------------------- time: 00:32:09 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986511/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986511/ "2020-04-26T10:37:37.080458+0000 mgr.x (mgr.7377) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986512] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:25:53 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986512/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986512/ "2020-04-26T10:47:25.956704+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986516] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/pool-snaps-few-objects.yaml} ----------------------------------------------------------------- time: 00:28:56 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986516/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986516/ "2020-04-26T10:32:29.180854+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986520] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read-overwrites.yaml} ----------------------------------------------------------------- time: 00:22:39 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986520/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986520/ "2020-04-26T10:35:15.861187+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986521] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{rhel_8.yaml} tasks/insights.yaml} ----------------------------------------------------------------- time: 00:12:11 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986521/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986521/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d69041a95b0941c89821740cc6a46c12 Test failure: test_crash_history (tasks.mgr.test_insights.TestInsights) [4986522] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:23:50 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986522/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986522/ "2020-04-26T10:36:00.473817+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986528] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/radosbench-high-concurrency.yaml} ----------------------------------------------------------------- time: 00:40:16 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986528/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986528/ "2020-04-26T10:46:23.239276+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986532] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/sync-many.yaml workloads/snaps-few-objects.yaml} ----------------------------------------------------------------- time: 00:30:55 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986532/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986532/ "2020-04-26T10:45:31.646522+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986534] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:11:24 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986534/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986534/ "2020-04-26T11:58:18.516488+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986535] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/radosbench.yaml} ----------------------------------------------------------------- time: 01:36:48 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986535/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986535/ "2020-04-26T10:38:15.985666+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986536] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-low-osd-mem-target.yaml supported-random-distro$/{rhel_8.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 01:09:14 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986536/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986536/ "2020-04-26T10:40:59.348482+0000 mgr.y (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986538] rados/valgrind-leaks/{1-start.yaml 2-inject-leak/osd.yaml centos_latest.yaml} ----------------------------------------------------------------- time: 00:18:48 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986538/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986538/ "2020-04-26T10:46:49.375422+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986540] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-hybrid.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} ----------------------------------------------------------------- time: 00:29:24 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986540/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986540/ "2020-04-26T10:48:03.537069+0000 mgr.x (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986541] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-hybrid.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} ----------------------------------------------------------------- time: 00:22:29 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986541/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986541/ "2020-04-26T10:41:44.445260+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986543] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/jewel.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} ----------------------------------------------------------------- time: 02:05:46 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986543/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986543/ psutil.NoSuchProcess process no longer exists (pid=5243) [4986545] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:33:01 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986545/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986545/ "2020-04-26T10:46:27.023812+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986546] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/redirect.yaml} ----------------------------------------------------------------- time: 00:16:56 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986546/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986546/ "2020-04-26T10:53:36.794712+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986548] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-small-objects-balanced.yaml} ----------------------------------------------------------------- time: 00:20:17 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986548/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986548/ "2020-04-26T10:51:17.185101+0000 mgr.y (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986552] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{rhel_8.yaml} tasks/module_selftest.yaml} ----------------------------------------------------------------- time: 00:32:29 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986552/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986552/ "2020-04-26T10:47:22.810154+0000 mgr.z (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986553] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/rados_workunit_loadgen_mix.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986553/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986553/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d5feeb1f23fc48c397eecd63271560dd Command failed on smithi100 with status 1: 'sudo yum install -y kernel' [4986554] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/redirect_promote_tests.yaml} ----------------------------------------------------------------- time: 00:15:42 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986554/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986554/ "2020-04-26T10:47:27.783034+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986556] rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/osd.yaml} ----------------------------------------------------------------- time: 02:11:59 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986556/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986556/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a3819af56f5a403c979ff66e583e8104 psutil.NoSuchProcess process no longer exists (pid=29296) [4986559] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/redirect_set_object.yaml} ----------------------------------------------------------------- time: 00:13:17 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986559/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986559/ "2020-04-26T11:17:23.212195+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986561] rados/cephadm/workunits/{distro/ubuntu_latest.yaml task/test_cephadm.yaml} ----------------------------------------------------------------- time: 00:08:13 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986561/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986561/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=dd0babfcf323422ab312990ab7527b31 Command failed (workunit test cephadm/test_cephadm.sh) on smithi114 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4a4147f663046b7be09a84aadbd148aa1416133d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [4986564] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-small-objects-overwrites.yaml} ----------------------------------------------------------------- time: 00:24:45 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986564/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986564/ "2020-04-26T10:53:47.109710+0000 mgr.x (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986565] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:15:24 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986565/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986565/ "2020-04-26T11:27:12.193339+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986566] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/luminous-v1only.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/careful.yaml thrashosds-health.yaml workloads/radosbench.yaml} ----------------------------------------------------------------- time: 01:51:28 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986566/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986566/ Command failed on smithi063 with status 125: 'sudo docker kill -s Signals.SIGHUP ceph-5c47d8bc-87ad-11ea-a068-001a4aab830c-osd.7' [4986567] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/set-chunk-promote-flush.yaml} ----------------------------------------------------------------- time: 00:11:26 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986567/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986567/ "2020-04-26T10:51:44.741899+0000 mgr.y (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986572] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 01:20:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986572/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986572/ "2020-04-26T11:07:25.409781+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986574] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-stupid.yaml supported-random-distro$/{rhel_8.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 01:09:30 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986574/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986574/ "2020-04-26T10:57:19.656734+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986576] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/set-chunks-read.yaml} ----------------------------------------------------------------- time: 00:14:28 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986576/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986576/ "2020-04-26T10:59:57.280723+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986577] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:24:28 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986577/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986577/ "2020-04-26T11:01:07.827241+0000 mgr.y (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986580] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_workunit_loadgen_mostlyread.yaml} ----------------------------------------------------------------- time: 00:30:45 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986580/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986580/ "2020-04-26T10:57:35.251371+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986581] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects-fast-read.yaml} ----------------------------------------------------------------- time: 00:24:04 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986581/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986581/ "2020-04-26T10:59:36.787372+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986583] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/small-objects-balanced.yaml} ----------------------------------------------------------------- time: 00:21:30 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986583/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986583/ "2020-04-26T10:59:45.895099+0000 mgr.y (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986585] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-snappy.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/progress.yaml} ----------------------------------------------------------------- time: 00:15:43 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986585/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986585/ "2020-04-26T11:00:29.779153+0000 mgr.z (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986590] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/small-objects-localized.yaml} ----------------------------------------------------------------- time: 00:24:11 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986590/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986590/ "2020-04-26T11:05:51.801300+0000 mgr.y (mgr.4099) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986591] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/luminous.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/default.yaml thrashosds-health.yaml workloads/rbd_cls.yaml} ----------------------------------------------------------------- time: 00:19:23 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986591/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986591/ Command failed on smithi115 with status 125: 'sudo docker kill -s Signals.SIGHUP ceph-023822c6-87af-11ea-a068-001a4aab830c-osd.7' [4986593] rados/multimon/{clusters/6.yaml msgr-failures/many.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/mon_recovery.yaml} ----------------------------------------------------------------- time: 00:12:36 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986593/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986593/ "2020-04-26T11:03:57.833278+0000 mgr.y (mgr.4108) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986594] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:11:57 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986594/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986594/ "2020-04-26T11:08:45.205623+0000 mgr.y (mgr.4112) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986596] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/small-objects.yaml} ----------------------------------------------------------------- time: 00:19:45 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986596/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986596/ "2020-04-26T11:04:43.714098+0000 mgr.x (mgr.4102) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986600] rados/standalone/{supported-random-distro$/{rhel_8.yaml} workloads/scrub.yaml} ----------------------------------------------------------------- time: 00:25:48 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986600/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986600/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=9827e3edc5c84d7dad9fc41289daa444 Command failed (workunit test scrub/osd-scrub-repair.sh) on smithi139 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4a4147f663046b7be09a84aadbd148aa1416133d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub- repair.sh' [4986603] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-stupid.yaml rados.yaml tasks/mon_recovery.yaml validater/lockdep.yaml} ----------------------------------------------------------------- time: 00:12:30 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986603/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986603/ "2020-04-26T11:14:42.734325+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986604] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/snaps-few-objects-balanced.yaml} ----------------------------------------------------------------- time: 00:29:33 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986604/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986604/ "2020-04-26T11:06:23.635545+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986606] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} tasks/readwrite.yaml} ----------------------------------------------------------------- time: 00:15:45 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986606/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986606/ "2020-04-26T11:15:57.098580+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986608] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:27:25 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986608/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986608/ "2020-04-26T11:15:44.446068+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986610] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/filestore-xfs.yaml supported-random-distro$/{centos_8.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 01:06:35 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986610/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986610/ "2020-04-26T11:09:41.729637+0000 mgr.z (mgr.4120) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986611] rados/objectstore/{backends/objectstore.yaml supported-random-distro$/{centos_8.yaml}} ----------------------------------------------------------------- time: 00:55:15 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986611/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986611/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=01e7bf3281364dde96953ff357c2104b Command crashed: 'sudo TESTDIR=/home/ubuntu/cephtest bash -c \'mkdir $TESTDIR/archive/ostest && cd $TESTDIR/archive/ostest && ulimit -Sn 16384 && CEPH_ARGS="--no-log-to-stderr --log-file $TESTDIR/archive/ceph_test_objectstore.log --debug-filestore 20 --debug- bluestore 20" ceph_test_objectstore --gtest_filter=-*/3 --gtest_catch_exceptions=0\'' [4986613] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/snaps-few-objects-localized.yaml} ----------------------------------------------------------------- time: 00:34:18 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986613/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986613/ "2020-04-26T11:15:52.555433+0000 mgr.x (mgr.4104) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986615] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/osd-delay.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/minsize_recovery.yaml thrashosds-health.yaml workloads/ec-small-objects-many-deletes.yaml} ----------------------------------------------------------------- time: 00:19:59 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986615/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986615/ "2020-04-26T11:12:11.795319+0000 mgr.x (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986616] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-zlib.yaml supported-random-distro$/{rhel_8.yaml} tasks/prometheus.yaml} ----------------------------------------------------------------- time: 00:14:18 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986616/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986616/ "2020-04-26T11:20:49.394467+0000 mgr.z (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986619] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/mimic-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/mapgap.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} ----------------------------------------------------------------- time: 00:37:05 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986619/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986619/ Command failed on smithi017 with status 125: 'sudo docker kill -s Signals.SIGHUP ceph-13464d4a-87b4-11ea-a068-001a4aab830c-osd.5' [4986621] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/snaps-few-objects.yaml} ----------------------------------------------------------------- time: 00:28:12 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986621/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986621/ "2020-04-26T11:17:52.157873+0000 mgr.x (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986624] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:12:17 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986624/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986624/ "2020-04-26T12:19:30.419097+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986625] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/write_fadvise_dontneed.yaml} ----------------------------------------------------------------- time: 00:17:10 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986625/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986625/ "2020-04-26T11:21:17.296443+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986631] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/repair_test.yaml} ----------------------------------------------------------------- time: 00:16:59 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986631/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986631/ "2020-04-26T11:17:33.498235+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986636] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/filestore-xfs.yaml rados.yaml tasks/rados_api_tests.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 00:45:48 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986636/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986636/ "2020-04-26T11:29:37.643740+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986638] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:27:35 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986638/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986638/ "2020-04-26T11:24:09.474483+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986640] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache-agent-big.yaml} ----------------------------------------------------------------- time: 00:18:28 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986640/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986640/ "2020-04-26T11:21:19.134206+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986644] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-zstd.yaml supported-random-distro$/{centos_8.yaml} tasks/workunits.yaml} ----------------------------------------------------------------- time: 00:08:35 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986644/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986644/ "2020-04-26T11:20:50.826069+0000 mgr.z (mgr.4117) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986645] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-bitmap.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 01:07:22 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986645/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986645/ "2020-04-26T11:25:56.361006+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986650] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack.yaml start.yaml} 1-install/nautilus.yaml 2-partial-upgrade/firsthalf.yaml 3-thrash/default.yaml 4-workload/{rbd-cls.yaml rbd-import-export.yaml readwrite.yaml snaps-few-objects.yaml} 5-workload/{radosbench.yaml rbd_api.yaml} 6-finish-upgrade.yaml 7-octopus.yaml 8-workload/{rbd-python.yaml snaps-many-objects.yaml} bluestore-bitmap.yaml thrashosds-health.yaml ubuntu_latest.yaml} ----------------------------------------------------------------- time: 00:04:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986650/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986650/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=2a3061f4e5c442dbb5c75834117aff98 psutil.NoSuchProcess process no longer exists (pid=7481) [4986651] rados/valgrind-leaks/{1-start.yaml 2-inject-leak/mon.yaml centos_latest.yaml} ----------------------------------------------------------------- time: 00:19:08 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986651/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986651/ "2020-04-26T11:32:10.538909+0000 mgr.x (mgr.4100) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986653] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/cache-agent-small.yaml} ----------------------------------------------------------------- time: 00:12:26 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986653/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986653/ "2020-04-26T11:23:08.222694+0000 mgr.x (mgr.4109) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986656] rados/cephadm/orchestrator_cli/{2-node-mgr.yaml orchestrator_cli.yaml supported-random-distro$/{centos_8.yaml}} ----------------------------------------------------------------- time: 00:13:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986656/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986656/ "2020-04-26T11:25:54.671002+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986657] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} ----------------------------------------------------------------- time: 00:29:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986657/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986657/ "2020-04-26T11:30:22.576278+0000 mgr.x (mgr.7356) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986658] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/cache-pool-snaps-readproxy.yaml} ----------------------------------------------------------------- time: 00:22:16 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986658/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986658/ "2020-04-26T11:35:09.541249+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986660] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:07:56 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986660/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986660/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e2e0ddc8c84c4e4589f166a6fed3cea1 timed out [4986663] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/scrub_test.yaml} ----------------------------------------------------------------- time: 00:11:17 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986663/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986663/ "2020-04-26T11:26:58.205198+0000 mgr.y (mgr.4110) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986667] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{default.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/cache-pool-snaps.yaml} ----------------------------------------------------------------- time: 00:36:22 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986667/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986667/ "2020-04-26T11:32:58.765352+0000 mgr.x (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986669] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} ----------------------------------------------------------------- time: 00:23:50 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986669/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986669/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ae91ed7d26aa4915aaa1c0a7e2a6844b reached maximum tries (180) after waiting for 180 seconds [4986670] rados/cephadm/upgrade/{1-start.yaml 2-start-upgrade.yaml 3-wait.yaml distro$/{ubuntu_18.04_podman.yaml} fixed-2.yaml} ----------------------------------------------------------------- time: 01:28:58 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986670/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986670/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1a9a08e50920430b9c647d4116291ce8 psutil.NoSuchProcess process no longer exists (pid=16122) [4986672] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/default/{default.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-bitmap.yaml rados.yaml tasks/rados_api_tests.yaml validater/lockdep.yaml} ----------------------------------------------------------------- time: 00:24:02 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986672/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986672/ "2020-04-26T11:33:24.698813+0000 mgr.y (mgr.4101) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986675] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-active-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/cache-snaps-balanced.yaml} ----------------------------------------------------------------- time: 00:27:27 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986675/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986675/ "2020-04-26T11:36:01.104797+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986676] rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml} ----------------------------------------------------------------- time: 00:09:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986676/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986676/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=feecc17125ae46a2b7c53efd2fd0eea6 Command failed (workunit test cephadm/test_cephadm.sh) on smithi102 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4a4147f663046b7be09a84aadbd148aa1416133d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [4986677] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-hybrid.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} ----------------------------------------------------------------- time: 00:26:23 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986677/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986677/ "2020-04-26T11:35:52.947047+0000 mgr.y (mgr.4105) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986678] rados/mgr/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-hybrid.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/crash.yaml} ----------------------------------------------------------------- time: 00:10:32 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986678/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986678/ "2020-04-26T11:34:22.548990+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986680] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=clay-k=4-m=2.yaml} ----------------------------------------------------------------- time: 00:28:40 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986680/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986680/ "2020-04-26T11:37:39.508522+0000 mgr.y (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986681] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/cache-snaps.yaml} ----------------------------------------------------------------- time: 00:24:55 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986681/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986681/ "2020-04-26T11:34:05.463552+0000 mgr.y (mgr.4103) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986684] rados/dashboard/{clusters/{2-node-mgr.yaml} debug/mgr.yaml objectstore/bluestore-comp-lz4.yaml supported-random-distro$/{rhel_8.yaml} tasks/dashboard.yaml} ----------------------------------------------------------------- time: 01:09:35 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986684/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986684/ "2020-04-26T11:42:36.337216+0000 mgr.x (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986689] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-async-partial-recovery.yaml} backoff/peering.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/upmap.yaml msgr-failures/osd-delay.yaml msgr/async.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/none.yaml thrashosds-health.yaml workloads/cache.yaml} ----------------------------------------------------------------- time: 00:10:46 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986689/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986689/ "2020-04-26T11:38:37.881668+0000 mgr.x (mgr.4106) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986690] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} ----------------------------------------------------------------- time: 00:14:56 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986690/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986690/ "2020-04-26T11:45:53.422721+0000 mgr.x (mgr.4114) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986694] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus-v2only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/radosbench.yaml} ----------------------------------------------------------------- time: 01:15:01 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986694/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986694/ Command failed on smithi099 with status 125: 'sudo docker kill -s Signals.SIGHUP ceph-b616bd1c-87b3-11ea-a068-001a4aab830c-osd.8' [4986697] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/dedup_tier.yaml} ----------------------------------------------------------------- time: 00:14:39 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986697/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986697/ "2020-04-26T11:45:11.358888+0000 mgr.y (mgr.4107) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log [4986702] rados/verify/{centos_latest.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-thrash/none.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml tasks/rados_cls_all.yaml validater/valgrind.yaml} ----------------------------------------------------------------- time: 01:15:20 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986702/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986702/ "2020-04-26T11:54:08.893684+0000 mgr.y (mgr.4113) 1 : cluster [ERR] Failed to load ceph-mgr modules: insights" in cluster log Dead ================================================================= [4986445] rados/cephadm/with-work/{distro/centos_8.0.yaml fixed-2.yaml mode/root.yaml msgr/async-v2only.yaml start.yaml tasks/rados_python.yaml} ----------------------------------------------------------------- time: 00:24:02 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986445/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986445/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=d50c79a783964c708895f0ae71a8f26f ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS- Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in \n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-26 10:29:40.710878', 'end': '2020-04-26 10:36:17.225042', 'delta': '0:06:36.514164', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['Waiting for process with pid 20791 to finish.', 'CentOS-8 - AppStream 18 B/s | 2.3 kB 02:10 ', 'CentOS-8 - Base 18 B/s | 2.3 kB 02:11 ', 'CentOS-8 - Extras 18 B/s | 2.3 kB 02:12 ', 'Last metadata expiration check: 0:06:35 ago on Sun 26 Apr 2020 10:29:41 AM UTC.'], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in ', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_ git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base') [4986502] rados/cephadm/upgrade/{1-start.yaml 2-start-upgrade.yaml 3-wait.yaml distro$/{centos_8.0.yaml} fixed-2.yaml} ----------------------------------------------------------------- time: 00:28:22 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986502/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986502/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1e750c51058a4c9ebada37c8ba50b03b | 4.7 kB 00:00 \nlab-extras 895 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in \n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-26 10:50:43.966603', 'end': '2020-04-26 10:57:21.330373', 'delta': '0:06:37.363770', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['Waiting for process with pid 20773 to finish.', 'CentOS-8 - AppStream 18 B/s | 2.3 kB 02:10 ', 'CentOS-8 - Base 18 B/s | 2.3 kB 02:11 ', 'CentOS-8 - Extras 18 B/s | 2.3 kB 02:12 ', 'Extra Packages for Enterprise Linux 120 kB/s | 4.7 kB 00:00 ', 'lab-extras 895 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in ', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_ git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base') [4986515] rados/cephadm/smoke/{distro/centos_8.0.yaml fixed-2.yaml start.yaml} ----------------------------------------------------------------- time: 00:23:46 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986515/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986515/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=672052bec12b422f9de356f2682af3f6 02:10 \nCentOS-8 - Base 18 B/s | 2.3 kB 02:11 \nCentOS-8 - Extras 18 B/s | 2.3 kB 02:11 \nCopr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 49 kB/s | 4.7 kB 00:00 \nlab-extras 921 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in \n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-26 10:46:57.201092', 'end': '2020-04-26 10:53:32.963264', 'delta': '0:06:35.762172', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['Waiting for process with pid 20742 to finish.', 'CentOS-8 - AppStream 18 B/s | 2.3 kB 02:10 ', 'CentOS-8 - Base 18 B/s | 2.3 kB 02:11 ', 'CentOS-8 - Extras 18 B/s | 2.3 kB 02:11 ', 'Copr repo for ceph-el8 owned by ktdreyer 75 kB/s | 3.3 kB 00:00 ', 'Extra Packages for Enterprise Linux 49 kB/s | 4.7 kB 00:00 ', 'lab-extras 921 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in ', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_ git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base') [4986519] rados/cephadm/smoke-roleless/{distro/centos_8.0.yaml start.yaml} ----------------------------------------------------------------- time: 00:23:51 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986519/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986519/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a598fa8c23dc4b92a0f41a4d8c416b67 18 B/s | 2.3 kB 02:11 \nCentOS-8 - Extras 18 B/s | 2.3 kB 02:11 \nLast metadata expiration check: 0:13:12 ago on Sun 26 Apr 2020 10:52:11 AM UTC.', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in \n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-26 10:58:51.942403', 'end': '2020-04-26 11:05:23.571417', 'delta': '0:06:31.629014', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 18 B/s | 2.3 kB 02:08 ', 'CentOS-8 - Base 18 B/s | 2.3 kB 02:11 ', 'CentOS-8 - Extras 18 B/s | 2.3 kB 02:11 ', 'Last metadata expiration check: 0:13:12 ago on Sun 26 Apr 2020 10:52:11 AM UTC.'], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in ', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_ git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base') [4986579] rados/cephadm/with-work/{distro/centos_8.0.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml} ----------------------------------------------------------------- time: 00:28:11 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986579/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986579/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a449d3a429184d72ac6907d6c03b64dd 18 B/s | 2.3 kB 02:11 \nLast metadata expiration check: 0:13:07 ago on Sun 26 Apr 2020 11:18:08 AM UTC.', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS- Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in \n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site-packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-26 11:24:44.337551', 'end': '2020-04-26 11:31:16.105222', 'delta': '0:06:31.767671', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 18 B/s | 2.3 kB 02:08 ', 'CentOS-8 - Base 18 B/s | 2.3 kB 02:11 ', 'CentOS-8 - Extras 18 B/s | 2.3 kB 02:11 ', 'Last metadata expiration check: 0:13:07 ago on Sun 26 Apr 2020 11:18:08 AM UTC.'], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in ', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_ git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base') [4986683] rados/cephadm/smoke/{distro/centos_8.0.yaml fixed-2.yaml start.yaml} ----------------------------------------------------------------- time: 00:23:40 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986683/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986683/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4b50b70e99bd40f0baedbc9992dd51e5 synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in \n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-26 11:57:17.723085', 'end': '2020-04-26 12:03:50.383009', 'delta': '0:06:32.659924', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['CentOS-8 - AppStream 18 B/s | 2.3 kB 02:08 ', 'CentOS-8 - Base 18 B/s | 2.3 kB 02:11 ', 'CentOS-8 - Extras 18 B/s | 2.3 kB 02:12 ', 'Last metadata expiration check: 0:13:08 ago on Sun 26 Apr 2020 11:50:42 AM UTC.'], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in ', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_ git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base') [4986691] rados/cephadm/smoke-roleless/{distro/centos_8.0.yaml start.yaml} ----------------------------------------------------------------- time: 00:23:41 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986691/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986691/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=a4e00d00bb1a4529ba4f5a12ceb87a2e s with pid 20766 to finish.\nCentOS-8 - AppStream 18 B/s | 2.3 kB 02:10 \nCentOS-8 - Base 18 B/s | 2.3 kB 02:11 \nCentOS-8 - Extras 18 B/s | 2.3 kB 02:11 \nExtra Packages for Enterprise Linux 143 kB/s | 4.7 kB 00:00 \nlab-extras 909 kB/s | 2.9 kB 00:00 ', 'stderr': 'Failed to synchronize cache for repo \'CentOS-AppStream\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Base\', ignoring this repo.\nFailed to synchronize cache for repo \'CentOS-Extras\', ignoring this repo.\nTraceback (most recent call last):\n File "/bin/dnf", line 58, in \n main.user_main(sys.argv[1:], exit_code=True)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main\n errcode = main(args)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main\n return _main(base, args, cli_class, option_parser_class)\n File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main\n return cli_run(cli, base)\n File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run\n cli.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run\n return self.command.run()\n File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run\n self.base.conf.strict)\n File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install\n cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)\n File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install\n strict)\n File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip\n return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)\n File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install\n raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))\nValueError: Group_id \'base\' does not exist.', 'rc': 1, 'start': '2020-04-26 11:59:24.197102', 'end': '2020-04-26 12:05:59.955939', 'delta': '0:06:35.758837', 'changed': True, 'invocation': {'module_args': {'_raw_params': 'dnf -y groupinstall base --nobest && dnf -y group upgrade base', '_uses_shell': True, 'warn': True, 'stdin_add_newline': True, 'strip_empty_ends': True, 'argv': None, 'chdir': None, 'executable': None, 'creates': None, 'removes': None, 'stdin': None}}, 'warnings': ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."], 'stdout_lines': ['Waiting for process with pid 20766 to finish.', 'CentOS-8 - AppStream 18 B/s | 2.3 kB 02:10 ', 'CentOS-8 - Base 18 B/s | 2.3 kB 02:11 ', 'CentOS-8 - Extras 18 B/s | 2.3 kB 02:11 ', 'Extra Packages for Enterprise Linux 143 kB/s | 4.7 kB 00:00 ', 'lab-extras 909 kB/s | 2.9 kB 00:00 '], 'stderr_lines': ["Failed to synchronize cache for repo 'CentOS-AppStream', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Base', ignoring this repo.", "Failed to synchronize cache for repo 'CentOS-Extras', ignoring this repo.", 'Traceback (most recent call last):', ' File "/bin/dnf", line 58, in ', ' main.user_main(sys.argv[1:], exit_code=True)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 193, in user_main', ' errcode = main(args)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 64, in main', ' return _main(base, args, cli_class, option_parser_class)', ' File "/usr/lib/python3.6/site- packages/dnf/cli/main.py", line 99, in _main', ' return cli_run(cli, base)', ' File "/usr/lib/python3.6/site-packages/dnf/cli/main.py", line 115, in cli_run', ' cli.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/cli.py", line 1125, in run', ' return self.command.run()', ' File "/usr/lib/python3.6/site- packages/dnf/cli/commands/group.py", line 384, in run', ' self.base.conf.strict)', ' File "/usr/lib/python3.6/site- packages/dnf/base.py", line 1623, in env_group_install', ' cnt += self.group_install(group_id, types, exclude=exclude, strict=strict)', ' File "/usr/lib/python3.6/site-packages/dnf/base.py", line 1597, in group_install', ' strict)', ' File "/usr/lib/python3.6/site- packages/dnf/comps.py", line 93, in install_or_skip', ' return install_fnc(grp_or_env_id, types, exclude, strict, exclude_groups)', ' File "/usr/lib/python3.6/site-packages/dnf/comps.py", line 653, in _group_install', ' raise ValueError(_("Group_id \'%s\' does not exist.") % ucd(group_id))', "ValueError: Group_id 'base' does not exist."], '_ansible_no_log': False}}Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.co m_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworke r/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/l ib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_ git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/ src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping('tag:yaml.org,2002:map', data) File "/home/teuthwor ker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com _git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.c eph.com_git_teuthology_master/virtualenv/lib/python3.6/site- packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)yaml.representer.RepresenterError: ('cannot represent an object', 'dnf -y groupinstall base --nobest && dnf -y group upgrade base') Pass ================================================================= [4986374] rados/cephadm/smoke-roleless/{distro/centos_latest.yaml start.yaml} time: 00:10:26 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986374/ [4986375] rados/singleton/{all/mon-config.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:22 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986375/ [4986376] rados/singleton-nomsgr/{all/ceph-kvstore-tool.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:11:15 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986376/ [4986377] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:11:56 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986377/ [4986379] rados/cephadm/workunits/{distro/ubuntu_latest.yaml task/test_cephadm_repos.yaml} time: 00:03:37 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986379/ [4986382] rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:14:45 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986382/ [4986383] rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml} time: 00:30:26 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986383/ [4986386] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/few.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} time: 00:20:53 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986386/ [4986388] rados/cephadm/smoke/{distro/rhel_7.yaml fixed-2.yaml start.yaml} time: 00:14:44 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986388/ [4986389] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/sample_fio.yaml} time: 00:12:32 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986389/ [4986391] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/nautilus-v1only.yaml backoff/peering.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/fastclose.yaml rados.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} time: 00:20:59 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986391/ [4986393] rados/objectstore/{backends/filejournal.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986393/ [4986394] rados/singleton/{all/osd-recovery-incomplete.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:20:22 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986394/ [4986395] rados/cephadm/smoke-roleless/{distro/rhel_7.yaml start.yaml} time: 00:14:48 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986395/ [4986398] rados/singleton-nomsgr/{all/ceph-post-file.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:09:57 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986398/ [4986399] rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/root.yaml msgr/async.yaml start.yaml tasks/rados_python.yaml} time: 00:22:10 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986399/ [4986400] rados/multimon/{clusters/21.yaml msgr-failures/many.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} tasks/mon_recovery.yaml} time: 00:28:01 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986400/ [4986401] rados/singleton/{all/osd-recovery.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:12:39 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986401/ [4986403] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/sync.yaml workloads/rados_5925.yaml} time: 00:10:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986403/ [4986404] rados/cephadm/smoke/{distro/rhel_8.0.yaml fixed-2.yaml start.yaml} time: 00:14:01 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986404/ [4986405] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/sample_radosbench.yaml} time: 00:10:06 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986405/ [4986406] rados/cephadm/smoke-roleless/{distro/rhel_8.0.yaml start.yaml} time: 00:13:51 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986406/ [4986408] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} time: 00:27:04 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986408/ [4986410] rados/singleton/{all/peer.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:44 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986410/ [4986411] rados/standalone/{supported-random-distro$/{centos_8.yaml} workloads/mgr.yaml} time: 00:10:58 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986411/ [4986412] rados/cephadm/workunits/{distro/ubuntu_latest.yaml task/test_adoption.yaml} time: 00:08:13 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986412/ [4986413] rados/thrash-erasure-code-isa/{arch/x86_64.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=isa-k=2-m=1.yaml} time: 00:27:44 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986413/ [4986415] rados/singleton-nomsgr/{all/export-after-evict.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:23 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986415/ [4986418] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_cls_all.yaml} time: 00:14:04 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986418/ [4986420] rados/cephadm/with-work/{distro/ubuntu_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v1only.yaml start.yaml tasks/rados_api_tests.yaml} time: 00:30:48 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986420/ [4986421] rados/singleton/{all/pg-autoscaler.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:11:08 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986421/ [4986422] rados/cephadm/smoke/{distro/rhel_latest.yaml fixed-2.yaml start.yaml} time: 00:11:36 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986422/ [4986423] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/cosbench_64K_read_write.yaml} time: 00:18:06 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986423/ [4986426] rados/cephadm/smoke-roleless/{distro/rhel_latest.yaml start.yaml} time: 00:11:42 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986426/ [4986428] rados/objectstore/{backends/filestore-idempotent-aio-journal.yaml supported-random-distro$/{centos_8.yaml}} time: 02:34:18 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986428/ [4986431] rados/singleton/{all/pg-removal-interruption.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:31 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986431/ [4986433] rados/cephadm/smoke/{distro/ubuntu_18.04.yaml fixed-2.yaml start.yaml} time: 00:12:10 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986433/ [4986434] rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_no_skews.yaml} time: 00:07:26 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986434/ [4986435] rados/singleton-nomsgr/{all/full-tiering.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:11:27 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986435/ [4986436] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/force-sync-many.yaml workloads/rados_api_tests.yaml} time: 00:24:50 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986436/ [4986437] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04.yaml start.yaml} time: 00:12:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986437/ [4986439] rados/singleton/{all/radostool.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:14:58 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986439/ [4986442] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/cosbench_64K_write.yaml} time: 00:17:54 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986442/ [4986443] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:14:39 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986443/ [4986449] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-pg-log-overrides/normal_pg_log.yaml 2-recovery-overrides/{more-partial-recovery.yaml} backoff/peering_and_degraded.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/crush-compat.yaml msgr-failures/fastclose.yaml msgr/async-v1only.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} time: 00:24:52 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986449/ [4986450] rados/singleton/{all/random-eio.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:30:59 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986450/ [4986453] rados/cephadm/smoke/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml start.yaml} time: 00:12:49 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986453/ [4986454] rados/singleton-nomsgr/{all/health-warnings.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:10:15 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986454/ [4986456] rados/singleton/{all/rebuild-mondb.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:16:34 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986456/ [4986458] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman.yaml start.yaml} time: 00:12:06 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986458/ [4986459] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4K_rand_read.yaml} time: 00:12:18 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986459/ [4986460] rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/misc.yaml} time: 00:24:31 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986460/ [4986462] rados/cephadm/with-work/{distro/centos_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml} time: 00:28:40 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986462/ [4986464] rados/objectstore/{backends/filestore-idempotent.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 02:30:19 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986464/ [4986467] rados/singleton/{all/recovery-preemption.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:23:16 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986467/ [4986469] rados/cephadm/smoke/{distro/ubuntu_latest.yaml fixed-2.yaml start.yaml} time: 00:12:06 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986469/ [4986472] rados/cephadm/smoke-roleless/{distro/ubuntu_latest.yaml start.yaml} time: 00:11:43 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986472/ [4986473] rados/singleton-nomsgr/{all/large-omap-object-warnings.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:08:08 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986473/ [4986474] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} time: 00:26:03 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986474/ [4986477] rados/thrash-erasure-code-shec/{ceph.yaml clusters/{fixed-4.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-async-partial-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml} time: 00:12:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986477/ [4986478] rados/singleton/{all/resolve_stuck_peering.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:06 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986478/ [4986479] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4K_rand_rw.yaml} time: 00:12:31 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986479/ [4986481] rados/cephadm/with-work/{distro/rhel_8.0.yaml fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml tasks/rados_python.yaml} time: 00:25:03 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986481/ [4986484] rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml} time: 00:04:14 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986484/ [4986486] rados/singleton/{all/test-crash.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:53 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986486/ [4986491] rados/singleton-nomsgr/{all/lazy_omap_stats_output.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:12:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986491/ [4986492] rados/cephadm/smoke/{distro/centos_7.yaml fixed-2.yaml start.yaml} time: 00:12:30 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986492/ [4986493] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4M_rand_read.yaml} time: 00:10:33 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986493/ [4986494] rados/singleton/{all/test_envlibrados_for_rocksdb.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:18:08 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986494/ [4986496] rados/cephadm/smoke-roleless/{distro/centos_7.yaml start.yaml} time: 00:12:29 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986496/ [4986497] rados/multimon/{clusters/9.yaml msgr-failures/few.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_recovery.yaml} time: 00:14:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986497/ [4986499] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/one.yaml workloads/rados_mon_workunits.yaml} time: 00:27:27 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986499/ [4986501] rados/objectstore/{backends/fusestore.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:09:53 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986501/ [4986503] rados/singleton/{all/thrash-backfill-full.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 01:34:33 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986503/ [4986505] rados/standalone/{supported-random-distro$/{rhel_8.yaml} workloads/mon.yaml} time: 00:46:22 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986505/ [4986506] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:11:04 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986506/ [4986509] rados/cephadm/with-work/{distro/rhel_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml} time: 00:31:12 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986509/ [4986510] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4M_rand_rw.yaml} time: 00:13:15 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986510/ [4986513] rados/singleton-nomsgr/{all/librados_hello_world.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:12:21 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986513/ [4986514] rados/singleton/{all/thrash-eio.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:29:33 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986514/ [4986517] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml objectstore/bluestore-hybrid.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{rhel_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-radosbench.yaml} time: 01:30:43 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986517/ [4986518] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-install/jewel-v1only.yaml backoff/normal.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/off.yaml distro$/{centos_7.6.yaml} msgr-failures/osd-delay.yaml rados.yaml thrashers/none.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} time: 00:17:21 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986518/ [4986523] rados/singleton/{all/thrash-rados/{thrash-rados.yaml thrashosds-health.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:22:28 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986523/ [4986524] rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/root.yaml msgr/async.yaml start.yaml tasks/rados_python.yaml} time: 00:21:45 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986524/ [4986525] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/rados_workunit_loadgen_big.yaml} time: 00:29:38 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986525/ [4986526] rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml} time: 00:09:21 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986526/ [4986527] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/fio_4M_rand_write.yaml} time: 00:11:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986527/ [4986529] rados/multimon/{clusters/21.yaml msgr-failures/many.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/mon_clock_no_skews.yaml} time: 00:07:55 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986529/ [4986530] rados/singleton-nomsgr/{all/msgr.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:17:50 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986530/ [4986531] rados/singleton/{all/thrash_cache_writeback_proxy_none.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:21:11 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986531/ [4986533] rados/cephadm/smoke/{distro/centos_latest.yaml fixed-2.yaml start.yaml} time: 00:10:45 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986533/ [4986537] rados/objectstore/{backends/keyvaluedb.yaml supported-random-distro$/{centos_8.yaml}} time: 00:12:15 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986537/ [4986539] rados/cephadm/smoke-roleless/{distro/centos_latest.yaml start.yaml} time: 00:10:25 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986539/ [4986542] rados/singleton/{all/watch-notify-same-primary.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:07:50 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986542/ [4986544] rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v1only.yaml start.yaml tasks/rados_api_tests.yaml} time: 00:31:01 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986544/ [4986547] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4K_rand_read.yaml} time: 00:11:44 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986547/ [4986549] rados/cephadm/smoke/{distro/rhel_7.yaml fixed-2.yaml start.yaml} time: 00:15:04 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986549/ [4986550] rados/singleton/{all/admin-socket.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:08:08 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986550/ [4986551] rados/singleton-nomsgr/{all/multi-backfill-reject.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:22:46 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986551/ [4986555] rados/cephadm/smoke-roleless/{distro/rhel_7.yaml start.yaml} time: 00:15:03 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986555/ [4986557] rados/cephadm/with-work/{distro/ubuntu_latest.yaml fixed-2.yaml mode/root.yaml msgr/async-v2only.yaml start.yaml tasks/rados_python.yaml} time: 00:21:36 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986557/ [4986558] rados/singleton/{all/deduptool.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:11:46 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986558/ [4986560] rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_clock_with_skews.yaml} time: 00:07:10 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986560/ [4986562] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4K_seq_read.yaml} time: 00:10:22 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986562/ [4986563] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/sync.yaml workloads/pool-create-delete.yaml} time: 00:15:36 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986563/ [4986568] rados/cephadm/smoke/{distro/rhel_8.0.yaml fixed-2.yaml start.yaml} time: 00:13:57 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986568/ [4986569] rados/singleton/{all/divergent_priors.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:32 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986569/ [4986570] rados/singleton-nomsgr/{all/osd_stale_reads.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:21:15 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986570/ [4986571] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/mapgap.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:11:13 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986571/ [4986573] rados/cephadm/smoke-roleless/{distro/rhel_8.0.yaml start.yaml} time: 00:14:12 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986573/ [4986575] rados/objectstore/{backends/objectcacher-stress.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:25:59 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986575/ [4986578] rados/singleton/{all/divergent_priors2.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:10:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986578/ [4986582] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_rand_read.yaml} time: 00:11:37 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986582/ [4986584] rados/cephadm/smoke/{distro/rhel_latest.yaml fixed-2.yaml start.yaml} time: 00:11:47 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986584/ [4986586] rados/singleton-bluestore/{all/cephtool.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:29:23 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986586/ [4986587] rados/singleton/{all/dump-stuck.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:12:33 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986587/ [4986588] rados/cephadm/smoke-roleless/{distro/rhel_latest.yaml start.yaml} time: 00:11:30 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986588/ [4986589] rados/singleton-nomsgr/{all/pool-access.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:11:15 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986589/ [4986592] rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml} time: 00:04:52 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986592/ [4986595] rados/singleton/{all/ec-lost-unfound.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:35:53 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986595/ [4986597] rados/cephadm/with-work/{distro/centos_latest.yaml fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml tasks/rados_python.yaml} time: 00:19:25 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986597/ [4986598] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{centos_8.yaml} thrashers/force-sync-many.yaml workloads/rados_5925.yaml} time: 00:10:24 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986598/ [4986599] rados/perf/{ceph.yaml objectstore/bluestore-comp.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_seq_read.yaml} time: 00:11:21 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986599/ [4986601] rados/cephadm/smoke/{distro/ubuntu_18.04.yaml fixed-2.yaml start.yaml} time: 00:12:21 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986601/ [4986602] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-stupid.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} time: 00:27:34 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986602/ [4986605] rados/singleton/{all/erasure-code-nonregression.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:07:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986605/ [4986607] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04.yaml start.yaml} time: 00:11:51 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986607/ [4986609] rados/singleton-nomsgr/{all/recovery-unfound-found.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:25:33 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986609/ [4986612] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/fast.yaml msgr-failures/few.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{centos_8.yaml} thrashers/default.yaml thrashosds-health.yaml workloads/ec-snaps-few-objects-overwrites.yaml} time: 00:27:53 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986612/ [4986614] rados/cephadm/with-work/{distro/rhel_8.0.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml} time: 00:34:11 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986614/ [4986617] rados/singleton/{all/lost-unfound-delete.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:35:23 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986617/ [4986618] rados/perf/{ceph.yaml objectstore/bluestore-low-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_4M_write.yaml} time: 00:09:47 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986618/ [4986620] rados/cephadm/smoke/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml start.yaml} time: 00:12:44 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986620/ [4986622] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman.yaml start.yaml} time: 00:12:10 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986622/ [4986623] rados/singleton/{all/lost-unfound.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:30:34 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986623/ [4986626] rados/multimon/{clusters/9.yaml msgr-failures/few.yaml msgr/async-v1only.yaml no_pools.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/mon_clock_no_skews.yaml} time: 00:07:53 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986626/ [4986627] rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml} time: 00:08:33 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986627/ [4986628] rados/singleton-nomsgr/{all/version-number-sanity.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:11:49 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986628/ [4986629] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/many.yaml workloads/rados_api_tests.yaml} time: 00:31:01 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986629/ [4986630] rados/cephadm/with-work/{distro/rhel_latest.yaml fixed-2.yaml mode/root.yaml msgr/async.yaml start.yaml tasks/rados_python.yaml} time: 00:22:24 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986630/ [4986632] rados/singleton/{all/max-pg-per-osd.from-mon.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:11:03 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986632/ [4986633] rados/perf/{ceph.yaml objectstore/bluestore-stupid.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/radosbench_omap_write.yaml} time: 00:22:22 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986633/ [4986634] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size.yaml 1-pg-log-overrides/short_pg_log.yaml 2-recovery-overrides/{more-async-recovery.yaml} backoff/normal.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} d-balancer/off.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/admin_socket_objecter_requests.yaml} time: 00:22:29 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986634/ [4986635] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/fastclose.yaml objectstore/filestore-xfs.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:10:44 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986635/ [4986637] rados/cephadm/smoke/{distro/ubuntu_latest.yaml fixed-2.yaml start.yaml} time: 00:12:07 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986637/ [4986639] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size.yaml 1-install/mimic.yaml backoff/peering_and_degraded.yaml ceph.yaml clusters/{openstack.yaml three-plus-one.yaml} d-balancer/crush-compat.yaml distro$/{centos_7.6.yaml} msgr-failures/few.yaml rados.yaml thrashers/morepggrow.yaml thrashosds-health.yaml workloads/test_rbd_api.yaml} time: 00:20:59 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986639/ [4986641] rados/singleton/{all/max-pg-per-osd.from-primary.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:12:38 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986641/ [4986642] rados/cephadm/smoke-roleless/{distro/ubuntu_latest.yaml start.yaml} time: 00:11:48 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986642/ [4986643] rados/thrash-erasure-code/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/fastclose.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{more-active-recovery.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/morepggrow.yaml thrashosds-health.yaml workloads/ec-small-objects.yaml} time: 00:21:04 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986643/ [4986646] rados/objectstore/{backends/alloc-hint.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:11:16 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986646/ [4986647] rados/rest/{mgr-restful.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:11:55 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986647/ [4986648] rados/singleton-nomsgr/{all/admin_socket_output.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:16:00 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986648/ [4986649] rados/standalone/{supported-random-distro$/{rhel_8.yaml} workloads/crush.yaml} time: 00:13:32 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986649/ [4986652] rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v1only.yaml start.yaml tasks/rados_api_tests.yaml} time: 00:30:22 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986652/ [4986654] rados/perf/{ceph.yaml objectstore/bluestore-basic-min-osd-mem-target.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/sample_fio.yaml} time: 00:12:31 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986654/ [4986655] rados/singleton/{all/max-pg-per-osd.from-replica.yaml msgr-failures/few.yaml msgr/async-v2only.yaml objectstore/bluestore-comp-zstd.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:11:37 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986655/ [4986659] rados/thrash-erasure-code-overwrites/{bluestore-bitmap.yaml ceph.yaml clusters/{fixed-2.yaml openstack.yaml} fast/normal.yaml msgr-failures/osd-delay.yaml rados.yaml recovery-overrides/{more-async-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/fastread.yaml thrashosds-health.yaml workloads/ec-pool-snaps-few-objects-overwrites.yaml} time: 00:28:34 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986659/ [4986661] rados/cephadm/smoke/{distro/centos_7.yaml fixed-2.yaml start.yaml} time: 00:12:42 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986661/ [4986662] rados/multimon/{clusters/21.yaml msgr-failures/many.yaml msgr/async-v2only.yaml no_pools.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml} tasks/mon_clock_with_skews.yaml} time: 00:07:59 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986662/ [4986664] rados/singleton/{all/mon-auth-caps.yaml msgr-failures/many.yaml msgr/async.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:20 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986664/ [4986665] rados/cephadm/smoke-roleless/{distro/centos_7.yaml start.yaml} time: 00:12:58 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986665/ [4986666] rados/monthrash/{ceph.yaml clusters/3-mons.yaml msgr-failures/mon-delay.yaml msgr/async.yaml objectstore/bluestore-comp-snappy.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} thrashers/one.yaml workloads/rados_mon_osdmap_prune.yaml} time: 00:55:09 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986666/ [4986668] rados/singleton-nomsgr/{all/balancer.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:12 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986668/ [4986671] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-bitmap.yaml rados.yaml recovery-overrides/{default.yaml} supported-random-distro$/{ubuntu_latest.yaml} thrashers/pggrow.yaml thrashosds-health.yaml workloads/ec-rados-plugin=jerasure-k=4-m=2.yaml} time: 00:27:56 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986671/ [4986673] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/sample_radosbench.yaml} time: 00:10:27 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986673/ [4986674] rados/singleton/{all/mon-config-key-caps.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-low-osd-mem-target.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:09:24 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986674/ [4986679] rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/root.yaml msgr/async-v2only.yaml start.yaml tasks/rados_python.yaml} time: 00:22:15 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986679/ [4986682] rados/singleton/{all/mon-config-keys.yaml msgr-failures/many.yaml msgr/async-v2only.yaml objectstore/bluestore-stupid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:16:36 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986682/ [4986685] rados/objectstore/{backends/ceph_objectstore_tool.yaml supported-random-distro$/{centos_8.yaml}} time: 00:14:16 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986685/ [4986686] rados/singleton-nomsgr/{all/cache-fs-trunc.yaml rados.yaml supported-random-distro$/{rhel_8.yaml}} time: 00:11:51 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986686/ [4986687] rados/perf/{ceph.yaml objectstore/bluestore-bitmap.yaml openstack.yaml settings/optimized.yaml ubuntu_latest.yaml workloads/cosbench_64K_read_write.yaml} time: 00:17:49 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986687/ [4986688] rados/basic/{ceph.yaml clusters/{fixed-2.yaml openstack.yaml} msgr-failures/few.yaml msgr/async.yaml objectstore/bluestore-hybrid.yaml rados.yaml supported-random-distro$/{rhel_8.yaml} tasks/rados_api_tests.yaml} time: 00:26:30 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986688/ [4986692] rados/singleton/{all/mon-config.yaml msgr-failures/few.yaml msgr/async.yaml objectstore/filestore-xfs.yaml rados.yaml supported-random-distro$/{centos_8.yaml}} time: 00:09:09 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986692/ [4986693] rados/multimon/{clusters/3.yaml msgr-failures/few.yaml msgr/async.yaml no_pools.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} tasks/mon_recovery.yaml} time: 00:10:01 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986693/ [4986695] rados/cephadm/with-work/{distro/ubuntu_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml} time: 00:30:25 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986695/ [4986696] rados/standalone/{supported-random-distro$/{ubuntu_latest.yaml} workloads/erasure-code.yaml} time: 00:35:19 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986696/ [4986698] rados/monthrash/{ceph.yaml clusters/9-mons.yaml msgr-failures/few.yaml msgr/async-v1only.yaml objectstore/bluestore-comp-zlib.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml} thrashers/sync-many.yaml workloads/rados_mon_workunits.yaml} time: 00:24:50 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986698/ [4986699] rados/cephadm/smoke/{distro/centos_latest.yaml fixed-2.yaml start.yaml} time: 00:10:31 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986699/ [4986700] rados/singleton/{all/osd-backfill.yaml msgr-failures/many.yaml msgr/async-v1only.yaml objectstore/bluestore-bitmap.yaml rados.yaml supported-random-distro$/{ubuntu_latest.yaml}} time: 00:20:08 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986700/ [4986701] rados/thrash-erasure-code-big/{ceph.yaml cluster/{12-osds.yaml openstack.yaml} msgr-failures/osd-delay.yaml objectstore/bluestore-comp-lz4.yaml rados.yaml recovery-overrides/{more-partial-recovery.yaml} supported-random-distro$/{centos_8.yaml} thrashers/careful.yaml thrashosds-health.yaml workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml} time: 00:11:09 info: http://pulpito.ceph.com/kchai-2020-04-26_09:25:11-rados-wip-kefu-testing-2020-04-26-1313-distro-basic-smithi/4986701/ 2020-04-26T12:58:10.552 INFO:teuthology.results:starting coverage generation 2020-04-26T12:58:10.555 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'