2021-01-29T07:06:07.555 INFO:root:teuthology version: 1.0.0-f185165d 2021-01-29T07:06:07.558 INFO:teuthology.results:subset: '10/100000' 2021-01-29T07:06:07.558 INFO:teuthology.results:seed: '31' 2021-01-29T07:18:40.722 INFO:root:teuthology version: 1.0.0-f185165d 2021-01-29T07:18:40.775 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-29T19:17:53.780 INFO:teuthology.results:Tests finished! gathering results... 2021-01-29T19:17:55.431 INFO:scrape:Found 11 jobs 2021-01-29T19:17:56.527 INFO:scrape:Found 3 distinct failure reasons 2021-01-29T19:17:56.528 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi179 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=63a6cc5b44713249c4712a1e9d9665df01897098 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-01-29T19:17:56.529 INFO:scrape:4 jobs: ['5839242', '5839226', '5839240', '5839234'] 2021-01-29T19:17:56.529 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{distro/centos_latest', 'task/test_cephadm}'] 2021-01-29T19:17:56.529 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{distro/centos_latest', 'task/test_cephadm}'] 2021-01-29T19:17:56.530 INFO:scrape: 2021-01-29T19:17:56.530 INFO:scrape:Dead: b'2021-01-29T19:10:44.644 DEBUG:teuthology.exit:Finished running handlers' 2021-01-29T19:17:56.531 INFO:scrape:3 jobs: ['5839228', '5839232', '5839224'] 2021-01-29T19:17:56.532 INFO:scrape:suites intersection: ['openstack', 'rados/perf/{ceph', 'settings/optimized', 'ubuntu_latest'] 2021-01-29T19:17:56.532 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-basic-min-osd-mem-target', 'objectstore/bluestore-comp', 'objectstore/bluestore-stupid', 'openstack', 'rados/perf/{ceph', 'scheduler/dmclock_default_shards', 'scheduler/wpq_default_shards', 'settings/optimized', 'ubuntu_latest', 'workloads/cosbench_64K_read_write}', 'workloads/cosbench_64K_write}', 'workloads/radosbench_omap_write}'] 2021-01-29T19:17:56.533 INFO:scrape: 2021-01-29T19:17:56.533 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nautilus 2021-01-29T19:17:56.534 INFO:scrape:2 jobs: ['5839222', '5839236'] 2021-01-29T19:17:56.534 INFO:scrape:suites intersection: ['1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}'] 2021-01-29T19:17:56.535 INFO:scrape:suites union: ['1-install/nautilus', '2-partial-upgrade/firsthalf', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-octopus', '8-workload/{rbd-python', 'bluestore-bitmap', 'mon_election/classic', 'mon_election/connectivity', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashosds-health', 'ubuntu_latest}'] 2021-01-29T19:17:56.536 INFO:scrape: 2021-01-29T19:17:56.537 INFO:teuthology.results:Sending results to ksirivad@redhat.com: Test Run: ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/ failed: 6 dead: 3 running: 0 waiting: 0 queued: 0 passed: 2 Fail ================================================================= [5839222] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 00:02:44 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839222/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839222/ sentry: https://sentry.ceph.com/organizations/ceph/?query=79e7ada9d37d4420bbd4881d7e1efdc6 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref= nautilus [5839226] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:13:38 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839226/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839226/ sentry: https://sentry.ceph.com/organizations/ceph/?query=91c4a1505d2f4834bc0f2b1710152f46 Command failed (workunit test cephadm/test_cephadm.sh) on smithi006 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=63a6cc5b44713249c4712a1e9d9665df01897098 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5839234] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:13:26 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839234/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839234/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc1f47a195c946a58e9c2922ebe4ed5a Command failed (workunit test cephadm/test_cephadm.sh) on smithi075 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=63a6cc5b44713249c4712a1e9d9665df01897098 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5839236] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest} ----------------------------------------------------------------- time: 00:02:43 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839236/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839236/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c38aab255c164e7eae29ab4d52fbea84 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref= nautilus [5839240] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:13:44 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839240/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839240/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b8be71e310ab42a893ed475d93e0703b Command failed (workunit test cephadm/test_cephadm.sh) on smithi153 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=63a6cc5b44713249c4712a1e9d9665df01897098 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5839242] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm} ----------------------------------------------------------------- time: 00:13:10 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839242/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839242/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f34f20a5125e4fbaa567406264f76899 Command failed (workunit test cephadm/test_cephadm.sh) on smithi179 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=63a6cc5b44713249c4712a1e9d9665df01897098 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' Dead ================================================================= [5839224] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839224/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839224/ [5839228] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839228/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839228/ [5839232] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/cosbench_64K_write} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839232/ log: http://qa-proxy.ceph.com/teuthology/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839232/ Pass ================================================================= [5839230] rados/singleton/{all/pg-autoscaler-progress-off mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:10:14 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839230/ [5839238] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} time: 00:17:04 info: http://pulpito.ceph.com/ksirivad-2021-01-29_07:03:52-rados-wip-mgr-pg-autoscaler-improve-out-of-box-experience-distro-basic-smithi/5839238/