2020-05-24T17:25:48.228 INFO:root:teuthology version: 1.0.0-4413d31 2020-05-24T17:25:48.230 INFO:teuthology.results:seed: '5286' 2020-05-24T18:06:11.359 INFO:root:teuthology version: 1.0.0-4413d31 2020-05-24T18:06:11.373 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-05-24T22:29:16.954 INFO:teuthology.results:Tests finished! gathering results... 2020-05-24T22:29:17.095 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/ failed: 11 dead: 0 running: 0 waiting: 0 queued: 0 passed: 56 Fail ================================================================= [5071790] krbd/singleton/{conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml} ----------------------------------------------------------------- time: 02:19:48 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071790/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071790/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=572420a97492455bb9381e0996c2454c Command failed on smithi168 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludemk86cm -r -- '-g auto -g blockdev -x clone'" [5071799] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} ----------------------------------------------------------------- time: 00:40:55 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071799/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071799/ "2020-05-24 17:52:52.504360 mon.b mon.0 172.21.15.19:6789/0 104 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log [5071801] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml} ----------------------------------------------------------------- time: 00:55:14 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071801/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071801/ "2020-05-24 18:29:26.701992 mon.a mon.0 172.21.15.189:6789/0 138 : cluster [WRN] Health check failed: 27 slow ops, oldest one blocked for 30 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log [5071816] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:20:07 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071816/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071816/ "2020-05-24 18:03:39.263290 mon.b mon.0 172.21.15.45:6789/0 116 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 30 sec, osd.6 has slow ops (SLOW_OPS)" in cluster log [5071821] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml} ----------------------------------------------------------------- time: 00:51:03 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071821/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071821/ "2020-05-24 18:07:10.822106 mon.a mon.0 172.21.15.2:6789/0 169 : cluster [WRN] Health check failed: 14 slow ops, oldest one blocked for 31 sec, daemons [osd.0,osd.5] have slow ops. (SLOW_OPS)" in cluster log [5071824] krbd/singleton/{conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml} ----------------------------------------------------------------- time: 03:25:31 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071824/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071824/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=dabb4618c4184239b9545e08cba14342 Command failed on smithi138 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/exclude6Jbv5D -r -- '-g auto -g blockdev -x clone'" [5071832] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} ----------------------------------------------------------------- time: 00:48:01 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071832/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071832/ "2020-05-24 18:25:54.961369 mon.a mon.1 172.21.15.145:6789/0 26 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN)" in cluster log [5071834] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml} ----------------------------------------------------------------- time: 03:13:30 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071834/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071834/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=4d8cf847d8594420b7f76c9401254426 Command failed (workunit test suites/ffsb.sh) on smithi196 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cfaacc24ed0d53a9ca7ee8d4b61f409acc71a89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/ffsb.sh' [5071838] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml} ----------------------------------------------------------------- time: 03:58:52 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071838/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071838/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=86662f26f933440f810dd4b52883e34c Command failed (workunit test rbd/concurrent.sh) on smithi159 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1cfaacc24ed0d53a9ca7ee8d4b61f409acc71a89 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh' [5071849] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:20:03 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071849/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071849/ "2020-05-24 18:44:45.829254 mon.b mon.0 172.21.15.102:6789/0 173 : cluster [WRN] Health check failed: 8 slow ops, oldest one blocked for 30 sec, osd.7 has slow ops (SLOW_OPS)" in cluster log [5071853] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml} ----------------------------------------------------------------- time: 00:56:14 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071853/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071853/ "2020-05-24 18:26:38.835911 mon.a mon.0 172.21.15.53:6789/0 161 : cluster [WRN] Health check failed: 373 slow ops, oldest one blocked for 33 sec, daemons [osd.1,osd.3,osd.5,osd.6] have slow ops. (SLOW_OPS)" in cluster log Pass ================================================================= [5071787] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071787/ [5071788] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml} time: 00:29:11 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071788/ [5071789] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml} time: 00:20:23 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071789/ [5071791] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 00:43:17 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071791/ [5071792] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071792/ [5071793] krbd/wac/sysfs/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071793/ [5071794] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml} time: 00:14:18 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071794/ [5071795] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml} time: 00:17:03 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071795/ [5071796] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml} time: 00:11:56 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071796/ [5071797] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml} time: 00:15:05 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071797/ [5071798] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml} time: 00:43:22 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071798/ [5071800] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml} time: 00:24:24 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071800/ [5071802] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml} time: 00:16:51 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071802/ [5071803] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071803/ [5071804] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071804/ [5071805] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml} time: 00:10:49 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071805/ [5071806] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml} time: 00:11:06 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071806/ [5071807] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 00:47:27 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071807/ [5071808] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071808/ [5071809] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml} time: 00:10:47 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071809/ [5071810] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml} time: 00:11:03 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071810/ [5071811] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml} time: 00:16:49 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071811/ [5071812] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml} time: 00:11:17 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071812/ [5071813] krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071813/ [5071814] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kfsx.yaml} time: 00:14:43 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071814/ [5071815] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:45:01 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071815/ [5071817] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071817/ [5071818] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml} time: 00:10:24 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071818/ [5071819] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml} time: 00:15:37 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071819/ [5071820] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml} time: 00:10:39 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071820/ [5071822] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml} time: 00:28:30 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071822/ [5071823] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml} time: 00:39:11 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071823/ [5071825] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:44:37 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071825/ [5071826] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml} time: 00:11:29 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071826/ [5071827] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml} time: 00:15:38 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071827/ [5071828] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml} time: 00:14:12 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071828/ [5071829] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_read_only.yaml} time: 00:10:03 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071829/ [5071830] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml} time: 00:14:01 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071830/ [5071831] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml} time: 00:39:00 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071831/ [5071833] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml} time: 00:28:55 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071833/ [5071835] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071835/ [5071836] krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml} time: 00:18:22 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071836/ [5071837] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml} time: 00:16:17 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071837/ [5071839] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml} time: 00:11:21 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071839/ [5071840] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml} time: 00:10:44 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071840/ [5071841] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:47:41 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071841/ [5071842] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071842/ [5071843] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml} time: 00:11:18 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071843/ [5071844] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071844/ [5071845] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml} time: 00:10:48 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071845/ [5071846] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071846/ [5071847] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kfsx.yaml} time: 00:16:40 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071847/ [5071848] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 00:46:45 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071848/ [5071850] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml} time: 00:10:36 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071850/ [5071851] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml} time: 00:15:45 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071851/ [5071852] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml} time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2020-05-20_05:15:01-krbd-mimic-testing-basic-smithi/5071852/ 2020-05-24T22:29:17.390 INFO:teuthology.results:starting coverage generation 2020-05-24T22:29:17.396 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python3.6/subprocess.py", line 729, in __init__ restore_signals, start_new_session) File "/usr/lib/python3.6/subprocess.py", line 1364, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage': '/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-coverage'