2020-04-04T06:45:56.505 INFO:root:teuthology version: 1.0.0-37546b3 2020-04-04T06:45:56.506 INFO:teuthology.results:seed: '8443' 2020-04-04T07:24:19.863 INFO:root:teuthology version: 1.0.0-37546b3 2020-04-04T07:24:19.894 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-04-04T19:18:33.689 INFO:teuthology.results:Tests finished! gathering results... 2020-04-04T19:18:33.817 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/ failed: 17 dead: 4 running: 0 waiting: 0 queued: 0 passed: 46 Fail ================================================================= [4912249] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_simple_big.yaml} ----------------------------------------------------------------- time: 03:10:15 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912249/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912249/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f58e0e4b76f74ace9a19ff315951940b Command failed (workunit test rbd/simple_big.sh) on smithi132 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36ac2fb654d2cf4adb279402ce44a37699a8d949 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/simple_big.sh' [4912212] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:19:26 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912212/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912212/ "2020-04-04 08:13:55.812854 mon.a mon.0 172.21.15.2:6789/0 164 : cluster [WRN] Health check failed: 34 slow ops, oldest one blocked for 30 sec, osd.1 has slow ops (SLOW_OPS)" in cluster log [4912228] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} ----------------------------------------------------------------- time: 00:47:19 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912228/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912228/ "2020-04-04 08:07:34.043699 mon.b mon.0 172.21.15.16:6789/0 179 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,a (MON_DOWN)" in cluster log [4912243] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kfsx.yaml} ----------------------------------------------------------------- time: 11:22:39 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912243/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912243/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=1cf1b858cf434508934d9788b2730de5 psutil.NoSuchProcess process no longer exists (pid=5148) [4912245] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_iozone.yaml} ----------------------------------------------------------------- time: 00:17:00 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912245/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912245/ "2020-04-04 07:45:58.362762 mon.a mon.0 172.21.15.2:6789/0 134 : cluster [WRN] Health check failed: 54 slow ops, oldest one blocked for 34 sec, daemons [osd.0,osd.6,osd.7] have slow ops. (SLOW_OPS)" in cluster log [4912230] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_ffsb.yaml} ----------------------------------------------------------------- time: 00:36:51 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912230/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912230/ "2020-04-04 08:51:12.068585 mon.b mon.0 172.21.15.89:6789/0 137 : cluster [WRN] Health check failed: 33 slow ops, oldest one blocked for 30 sec, daemons [osd.2,osd.3,osd.6] have slow ops. (SLOW_OPS)" in cluster log [4912205] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_image_read.yaml} ----------------------------------------------------------------- time: 03:11:28 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912205/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912205/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=e7d6ace1017d4980910a292ff11a019b Command failed (workunit test rbd/image_read.sh) on smithi142 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36ac2fb654d2cf4adb279402ce44a37699a8d949 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/image_read.sh' [4912219] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_data_pool.yaml} ----------------------------------------------------------------- time: 03:11:31 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912219/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912219/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=6cbadae5cffa4455afa772ed1c1931e4 Command failed (workunit test rbd/krbd_data_pool.sh) on smithi116 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36ac2fb654d2cf4adb279402ce44a37699a8d949 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_data_pool.sh' [4912195] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/mon-thrasher.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} ----------------------------------------------------------------- time: 00:37:01 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912195/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912195/ "2020-04-04 07:20:09.906320 mon.b mon.0 172.21.15.69:6789/0 100 : cluster [WRN] Health check failed: 1/3 mons down, quorum b,c (MON_DOWN)" in cluster log [4912220] krbd/singleton/{conf.yaml msgr-failures/many.yaml tasks/rbd_xfstests.yaml} ----------------------------------------------------------------- time: 02:58:50 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912220/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912220/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=88f3a6f9f1c546eebcf1d59027c53a1d Command failed on smithi125 with status 2: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludeGomDAi -r -- '-g auto -g blockdev -x clone'" [4912197] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_ffsb.yaml} ----------------------------------------------------------------- time: 00:52:22 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912197/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912197/ "2020-04-04 07:11:59.340666 mon.b mon.0 172.21.15.86:6789/0 124 : cluster [WRN] Health check failed: 14 slow ops, oldest one blocked for 33 sec, daemons [osd.3,osd.6] have slow ops. (SLOW_OPS)" in cluster log [4912239] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_image_read.yaml} ----------------------------------------------------------------- time: 03:11:57 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912239/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912239/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=3b590e6a798b43b7a7e9061f6882f917 Command failed (workunit test rbd/image_read.sh) on smithi006 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36ac2fb654d2cf4adb279402ce44a37699a8d949 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/image_read.sh' [4912186] krbd/singleton/{conf.yaml msgr-failures/few.yaml tasks/rbd_xfstests.yaml} ----------------------------------------------------------------- time: 02:14:17 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912186/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912186/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=06ded45d6a3b480bbfb22593c9014fa7 Command failed on smithi171 with status 2: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludef_yUZL -r -- '-g auto -g blockdev -x clone'" [4912234] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_concurrent.yaml} ----------------------------------------------------------------- time: 04:00:05 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912234/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912234/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=f5144c1785a0428882cf0659e3d92916 Command failed (workunit test rbd/concurrent.sh) on smithi203 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36ac2fb654d2cf4adb279402ce44a37699a8d949 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh' [4912185] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_data_pool.yaml} ----------------------------------------------------------------- time: 03:11:20 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912185/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912185/ sentry: http://sentry.ceph.com/sepia/teuthology/?q=10c742656fca42bb84f52f232c603755 Command failed (workunit test rbd/krbd_data_pool.sh) on smithi130 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=36ac2fb654d2cf4adb279402ce44a37699a8d949 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_data_pool.sh' [4912217] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_simple_big.yaml} ----------------------------------------------------------------- time: 00:51:24 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912217/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912217/ "2020-04-04 08:10:25.389742 mon.b mon.0 172.21.15.50:6789/0 119 : cluster [WRN] Health check failed: 32 slow ops, oldest one blocked for 33 sec, daemons [osd.2,osd.6] have slow ops. (SLOW_OPS)" in cluster log [4912215] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_unmap.yaml} ----------------------------------------------------------------- time: 00:13:58 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912215/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912215/ '/home/ubuntu/cephtest/archive/syslog/kern.log:2020-04-04T07:56:41.152863+0 0:00 smithi098 kernel: [ 620.828385] BUG: MAX_LOCKDEP_CHAIN_HLOCKS too low! ' in syslog Dead ================================================================= [4912240] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_whole_object_zeroout.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912240/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912240/ [4912210] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kfsx.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912210/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912210/ [4912225] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_read_only.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912225/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912225/ [4912214] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_parent_overlap.yaml} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912214/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912214/ Pass ================================================================= [4912191] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_kernel_untar_build.yaml} time: 00:14:07 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912191/ [4912190] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_exclusive_option.yaml} time: 00:11:54 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912190/ [4912193] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_latest_osdmap_on_map.yaml} time: 00:12:51 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912193/ [4912192] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_fallocate.yaml} time: 00:10:10 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912192/ [4912194] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_dbench.yaml} time: 00:40:21 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912194/ [4912196] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_enumerate.yaml} time: 00:20:01 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912196/ [4912199] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_msgr_segments.yaml} time: 00:07:57 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912199/ [4912198] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_netlink_enobufs.yaml} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912198/ [4912229] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_udev_enumerate.yaml} time: 00:28:12 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912229/ [4912232] krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/no-resets.yaml} time: 00:16:45 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912232/ [4912223] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_kernel_untar_build.yaml} time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912223/ [4912222] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_exclusive_option.yaml} time: 00:09:57 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912222/ [4912221] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:43:39 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912221/ [4912233] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_udev_netlink_enobufs.yaml} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912233/ [4912209] krbd/wac/wac/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml tasks/wac.yaml verify/many-resets.yaml} time: 00:16:25 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912209/ [4912208] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-off.yaml tasks/unmap.yaml} time: 00:08:42 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912208/ [4912224] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/krbd_fallocate.yaml} time: 00:14:10 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912224/ [4912204] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912204/ [4912207] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsx.yaml} time: 00:14:56 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912207/ [4912206] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_kernel.yaml} time: 00:09:06 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912206/ [4912201] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress.yaml} time: 00:09:11 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912201/ [4912200] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_concurrent.yaml} time: 00:14:28 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912200/ [4912203] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 00:47:23 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912203/ [4912202] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_huge_tickets.yaml} time: 00:09:31 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912202/ [4912248] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_trivial_sync.yaml} time: 00:09:13 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912248/ [4912241] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_kernel.yaml} time: 00:09:02 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912241/ [4912242] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsx.yaml} time: 00:16:20 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912242/ [4912244] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 00:43:36 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912244/ [4912247] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_unmap.yaml} time: 00:14:00 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912247/ [4912246] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_map_snapshot_io.yaml} time: 00:08:45 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912246/ [4912226] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/krbd_latest_osdmap_on_map.yaml} time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912226/ [4912188] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/pre-single-major.yaml tasks/unmap.yaml} time: 00:08:15 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912188/ [4912189] krbd/wac/sysfs/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/stable_pages_required.yaml} time: 00:07:41 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912189/ [4912187] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/backoff.yaml thrashosds-health.yaml workloads/rbd_fio.yaml} time: 00:42:48 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912187/ [4912184] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_fio.yaml} time: 00:28:53 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912184/ [4912183] krbd/basic/{ceph/ceph.yaml clusters/fixed-1.yaml conf.yaml tasks/krbd_huge_image.yaml} time: 00:07:55 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912183/ [4912231] krbd/unmap/{ceph/ceph.yaml clusters/separate-client.yaml conf.yaml filestore-xfs.yaml kernels/single-major-on.yaml tasks/unmap.yaml} time: 00:08:33 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912231/ [4912218] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_fio.yaml} time: 00:28:14 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912218/ [4912227] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_dbench.yaml} time: 00:38:15 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912227/ [4912235] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/many.yaml tasks/rbd_workunit_suites_fsstress.yaml} time: 00:09:46 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912235/ [4912236] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/few.yaml tasks/rbd_huge_tickets.yaml} time: 00:08:57 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912236/ [4912237] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/pggrow.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:48:40 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912237/ [4912238] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_suites_fsstress_ext4.yaml} time: 00:09:10 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912238/ [4912213] krbd/rbd-nomount/{clusters/fixed-3.yaml conf.yaml install/ceph.yaml msgr-failures/many.yaml tasks/rbd_map_snapshot_io.yaml} time: 00:09:25 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912213/ [4912211] krbd/thrash/{ceph/ceph.yaml clusters/fixed-3.yaml conf.yaml thrashers/upmap.yaml thrashosds-health.yaml workloads/rbd_workunit_suites_ffsb.yaml} time: 00:43:04 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912211/ [4912216] krbd/rbd/{clusters/fixed-3.yaml conf.yaml msgr-failures/few.yaml tasks/rbd_workunit_trivial_sync.yaml} time: 00:09:01 info: http://pulpito.ceph.com/teuthology-2020-04-01_05:15:02-krbd-mimic-testing-basic-smithi/4912216/ 2020-04-04T19:18:33.885 INFO:teuthology.results:starting coverage generation 2020-04-04T19:18:33.892 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 35, in main int(args['--timeout']), args['--dry-run']) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 84, in results generate_coverage(archive_dir, name) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/results.py", line 107, in generate_coverage archive_dir, File "/usr/lib/python2.7/subprocess.py", line 711, in __init__ errread, errwrite) File "/usr/lib/python2.7/subprocess.py", line 1343, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory