2021-09-09T21:11:02.894 INFO:root:teuthology version: 1.1.0-b135a4f8 2021-09-09T21:11:02.895 INFO:teuthology.results:seed: '5913' 2021-09-09T21:11:51.316 INFO:root:teuthology version: 1.1.0-b135a4f8 2021-09-09T21:11:51.322 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-09-10T00:53:07.691 INFO:teuthology.results:Tests finished! gathering results... 2021-09-10T00:53:10.045 INFO:scrape:Found 24 jobs 2021-09-10T00:53:10.046 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381659/teuthology.log 2021-09-10T00:53:11.319 INFO:scrape:Found 3 distinct failure reasons 2021-09-10T00:53:11.320 INFO:scrape:Dead: None 2021-09-10T00:53:11.321 INFO:scrape:1 jobs: ['6381659'] 2021-09-10T00:53:11.321 INFO:scrape: 2021-09-10T00:53:11.322 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rados/test.sh 2021-09-10T00:53:11.322 INFO:scrape:1 jobs: ['6381646'] 2021-09-10T00:53:11.323 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{centos_8}', 'tasks/{0-install', 'test/mon_thrash}}'] 2021-09-10T00:53:11.323 INFO:scrape: 2021-09-10T00:53:11.323 INFO:scrape:Failure: "2021-09-09T21:34:45.092881+0000 mds.a (mds.0) 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 34.521388 secs" in cluster log 2021-09-10T00:53:11.324 INFO:scrape:1 jobs: ['6381645'] 2021-09-10T00:53:11.324 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'openstack}', 'smoke/basic/{clusters/{fixed-3-cephfs', 'supported-random-distro$/{ubuntu_latest}', 'tasks/{0-install', 'test/libcephfs_interface_tests}}'] 2021-09-10T00:53:11.325 INFO:scrape: 2021-09-10T00:53:11.326 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/ failed: 2 dead: 1 running: 0 waiting: 0 queued: 0 passed: 21 Fail ================================================================= [6381645] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/libcephfs_interface_tests}} ----------------------------------------------------------------- time: 00:18:44 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381645/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381645/ "2021-09-09T21:34:45.092881+0000 mds.a (mds.0) 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 34.521388 secs" in cluster log [6381646] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/mon_thrash}} ----------------------------------------------------------------- time: 03:29:09 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381646/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381646/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a8187113da114edab88e52ddc3e79073 Command failed (workunit test rados/test.sh) on smithi180 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9989418f7d3c0967385a5f8693f1cf837d4449ed TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' Dead ================================================================= [6381659] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rgw_ec_s3tests}} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381659/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381659/ Error reimaging machines: reached maximum tries (60) after waiting for 900 seconds Pass ================================================================= [6381637] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/cfuse_workunit_suites_blogbench}} time: 00:30:02 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381637/ [6381638] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/cfuse_workunit_suites_fsstress}} time: 00:26:12 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381638/ [6381639] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/cfuse_workunit_suites_iozone}} time: 00:14:35 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381639/ [6381640] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/cfuse_workunit_suites_pjd}} time: 00:25:27 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381640/ [6381641] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/kclient_workunit_direct_io}} time: 00:23:17 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381641/ [6381642] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/kclient_workunit_suites_dbench}} time: 01:11:02 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381642/ [6381643] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/kclient_workunit_suites_fsstress}} time: 00:14:24 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381643/ [6381644] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/kclient_workunit_suites_pjd}} time: 00:25:38 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381644/ [6381647] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_api_tests}} time: 00:29:26 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381647/ [6381648] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_bench}} time: 01:40:59 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381648/ [6381649] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_cache_snaps}} time: 00:36:13 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381649/ [6381650] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_cls_all}} time: 00:19:08 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381650/ [6381651] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rados_ec_snaps}} time: 00:34:58 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381651/ [6381652] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rados_python}} time: 00:19:02 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381652/ [6381653] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rados_workunit_loadgen_mix}} time: 00:24:03 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381653/ [6381654] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_api_tests}} time: 00:39:48 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381654/ [6381655] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/{0-install test/rbd_cli_import_export}} time: 00:13:33 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381655/ [6381656] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rbd_fsx}} time: 00:13:02 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381656/ [6381657] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_python_api_tests}} time: 00:33:48 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381657/ [6381658] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/{0-install test/rbd_workunit_suites_iozone}} time: 00:28:46 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381658/ [6381660] smoke/basic/{clusters/{fixed-3-cephfs openstack} objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/{0-install test/rgw_s3tests}} time: 00:21:29 info: http://pulpito.ceph.com/yuriw-2021-09-09_21:10:52-smoke-pacific-distro-basic-smithi/6381660/