2020-04-03T10:00:22.822 INFO:root:teuthology version: 1.0.0-8191bbb 2020-04-03T10:00:22.823 INFO:teuthology.results:subset: '803/9999' 2020-04-03T10:00:22.823 INFO:teuthology.results:seed: '2477' 2020-04-03T10:46:10.285 INFO:root:teuthology version: 1.0.0-8191bbb 2020-04-03T10:46:10.317 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-04-03T13:27:12.934 INFO:teuthology.results:Tests finished! gathering results... 2020-04-03T13:27:13.008 INFO:teuthology.results:Sending results to tchaikov@gmail.com: Test Run: kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 15 Fail ================================================================= [4922232] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/openfiletable.yaml} ----------------------------------------------------------------- time: 00:11:31 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922232/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922232/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=19041018007449b88a9a5192886651d4 Test failure: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) [4922242] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/strays.yaml} ----------------------------------------------------------------- time: 00:09:30 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922242/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922242/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4941fb6562484e33b6cc406f62b855ba Test failure: test_dir_deletion (tasks.cephfs.test_strays.TestStrays) [4922237] fs/multifs/{begin.yaml clusters/1a3s-mds-2c-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/failover.yaml} ----------------------------------------------------------------- time: 00:36:53 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922237/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922237/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=27970035f742444fad0a74fef56baf51 Test failure: test_clients (tasks.cephfs.test_failover.TestMultiFilesystems) [4922248] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/volume-client/{py/2.yaml task/test/{test.yaml}}} ----------------------------------------------------------------- time: 00:14:56 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922248/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922248/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=ef1fe703eed8455abd331f9c947373db Test failure: test_evict_client (tasks.cephfs.test_volume_client.TestVolumeClient) [4922250] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/volumes.yaml} ----------------------------------------------------------------- time: 00:09:41 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922250/ log: http://qa-proxy.ceph.com/teuthology/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922250/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3be47c682d374acb89d74a44e3d8cedb Test failure: test_async_subvolume_rm (tasks.cephfs.test_volumes.TestVolumes) Pass ================================================================= [4922245] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/test_journal_migration.yaml} time: 00:15:24 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922245/ [4922244] fs/upgrade/featureful_client/old_client/{bluestore-bitmap.yaml clusters/1-mds-2-client-micro.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} overrides/{frag_enable.yaml multimds/yes.yaml pg-warn.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/{0-mimic.yaml 1-client.yaml 2-upgrade.yaml 3-compat_client/no.yaml}} time: 00:33:44 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922244/ [4922243] fs/multiclient/{begin.yaml clusters/1-mds-3-client.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} distros/ubuntu_latest.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cephfs_misc_tests.yaml} time: 00:20:14 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922243/ [4922246] fs/traceless/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_suites_fsstress.yaml traceless/50pc.yaml} time: 00:14:16 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922246/ [4922239] fs/snaps/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/snaptests.yaml} time: 01:17:16 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922239/ [4922238] fs/permission/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/cfuse_workunit_misc.yaml} time: 00:12:09 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922238/ [4922240] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/sessionmap/{sessionmap.yaml}} time: 00:18:18 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922240/ [4922249] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_dbench.yaml} time: 00:49:22 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922249/ [4922233] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-ec-root.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{rhel_8.yaml} tasks/pool-perm.yaml} time: 00:15:45 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922233/ [4922247] fs/verify/{begin.yaml centos_latest.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/bluestore-ec-root.yaml overrides/{frag_enable.yaml mon-debug.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} tasks/cfuse_workunit_suites_fsstress.yaml validater/valgrind.yaml} time: 01:54:57 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922247/ [4922231] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/no.yaml mount/fuse.yaml objectstore-ec/filestore-xfs.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_norstats.yaml} time: 00:11:19 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922231/ [4922241] fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-bitmap.yaml omap_limit/10.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_blogbench.yaml} time: 00:18:54 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922241/ [4922236] fs/32bits/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore-ec/filestore-xfs.yaml overrides/{faked-ino.yaml frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} time: 00:13:47 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922236/ [4922235] fs/basic_functional/{begin.yaml clusters/1-mds-4-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml objectstore/bluestore-bitmap.yaml overrides/{frag_enable.yaml no_client_pidfile.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/quota.yaml} time: 00:12:07 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922235/ [4922234] fs/thrash/{begin.yaml ceph-thrash/mds.yaml clusters/1-mds-1-client-coloc.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} mount/fuse.yaml msgr-failures/osd-mds-delay.yaml objectstore-ec/bluestore-comp.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{ubuntu_latest.yaml} tasks/cfuse_workunit_suites_fsstress.yaml} time: 00:21:52 info: http://pulpito.ceph.com/kchai-2020-04-03_10:00:01-fs-master-distro-basic-smithi/4922234/ 2020-04-03T13:27:13.127 INFO:teuthology.results:starting coverage generation 2020-04-03T13:27:13.135 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python2.7/subprocess.py", line 711, in __init__ errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1343, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory