2020-11-01T20:56:44.750 INFO:root:teuthology version: 1.0.0-41b569f 2020-11-01T20:56:44.752 INFO:teuthology.results:seed: '1179' 2020-11-01T21:53:21.594 INFO:root:teuthology version: 1.0.0-41b569f 2020-11-01T21:53:21.628 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-02T07:45:34.377 INFO:teuthology.results:Tests finished! gathering results... 2020-11-02T07:45:47.950 INFO:scrape:Found 100 jobs 2020-11-02T07:45:51.308 INFO:scrape:Found 5 distinct failure reasons 2020-11-02T07:45:51.309 INFO:scrape:Failure: "2020-11-01T22:46:37.645166+0000 osd.5 (osd.5) 3 : cluster [WRN] slow request osd_op(client.4361.0:53584 2.3 2:cee0b40c:::rbd_data.1131508c1732.0000000000005f53:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1404928~8192 in=8192b] snapc 0=[] RETRY=8 ondisk+retry+write+known_if_redirected e21) initiated 2020-11-01T22:46:07.255355+0000 currently waiting for sub ops" in cluster log 2020-11-02T07:45:51.309 INFO:scrape:1 jobs: ['5577268'] 2020-11-02T07:45:51.310 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'msgr-failures/many', 'tasks/rbd_simple_big}'] 2020-11-02T07:45:51.310 INFO:scrape: 2020-11-02T07:45:51.310 INFO:scrape:Failure: Command failed on smithi105 with status 120: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 20000 -K -U pool_client.0 image_client.0' 2020-11-02T07:45:51.311 INFO:scrape:1 jobs: ['5577230'] 2020-11-02T07:45:51.311 INFO:scrape:suites: ['clusters/3-node', 'conf', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'striping/default/{msgr-failures/many', 'tasks/fsx-1-client}'] 2020-11-02T07:45:51.311 INFO:scrape: 2020-11-02T07:45:51.311 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/concurrent.sh 2020-11-02T07:45:51.312 INFO:scrape:1 jobs: ['5577253'] 2020-11-02T07:45:51.312 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'msgr-failures/many', 'tasks/rbd_concurrent}'] 2020-11-02T07:45:51.312 INFO:scrape: 2020-11-02T07:45:51.313 INFO:scrape:Failure: Command failed on smithi007 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludef8biu575 -r -- '-g auto -g blockdev -x clone'" 2020-11-02T07:45:51.313 INFO:scrape:2 jobs: ['5577173', '5577224'] 2020-11-02T07:45:51.313 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2020-11-02T07:45:51.314 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2020-11-02T07:45:51.314 INFO:scrape: 2020-11-02T07:45:51.314 INFO:scrape:Failure: "2020-11-01T23:15:27.220973+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.81209.0:493014 2.5 2:b541cfe7:::rbd_header.114fb022a95b:head [watch reconnect cookie 18446462598732840967 gen 2877] snapc 0=[] ondisk+write+known_if_redirected e21) initiated 2020-11-01T23:14:56.882300+0000 currently started" in cluster log 2020-11-02T07:45:51.314 INFO:scrape:1 jobs: ['5577242'] 2020-11-02T07:45:51.315 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'msgr-failures/many', 'tasks/krbd_udev_enumerate}'] 2020-11-02T07:45:51.315 INFO:scrape: 2020-11-02T07:45:51.320 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 94 Fail ================================================================= [5577173] krbd/singleton/{bluestore-bitmap conf msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 09:25:38 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577173/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577173/ sentry: https://sentry.ceph.com/ceph/sepia/?query=f8021342ea754240b7192602ded75ef9 Command failed on smithi007 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludef8biu575 -r -- '-g auto -g blockdev -x clone'" [5577224] krbd/singleton/{bluestore-bitmap conf msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 09:58:36 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577224/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577224/ sentry: https://sentry.ceph.com/ceph/sepia/?query=ee31b2cb18a14b3f9bffb76f4c245616 Command failed on smithi025 with status 3: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludebl0lzf2g -r -- '-g auto -g blockdev -x clone'" [5577230] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} ----------------------------------------------------------------- time: 00:30:38 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577230/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577230/ sentry: https://sentry.ceph.com/ceph/sepia/?query=9b876ac8fe704b819a3b25ce4a9ea1b5 Command failed on smithi105 with status 120: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 20000 -K -U pool_client.0 image_client.0' [5577242] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_enumerate} ----------------------------------------------------------------- time: 03:11:28 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577242/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577242/ "2020-11-01T23:15:27.220973+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.81209.0:493014 2.5 2:b541cfe7:::rbd_header.114fb022a95b:head [watch reconnect cookie 18446462598732840967 gen 2877] snapc 0=[] ondisk+write+known_if_redirected e21) initiated 2020-11-01T23:14:56.882300+0000 currently started" in cluster log [5577253] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_concurrent} ----------------------------------------------------------------- time: 05:33:36 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577253/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577253/ sentry: https://sentry.ceph.com/ceph/sepia/?query=afaf6c12920b4e308824af576df5ffef Command failed (workunit test rbd/concurrent.sh) on smithi039 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8a2f2d82f49df1d5a94e97328f8b04a783d159d5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh' [5577268] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_simple_big} ----------------------------------------------------------------- time: 00:44:26 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577268/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577268/ "2020-11-01T22:46:37.645166+0000 osd.5 (osd.5) 3 : cluster [WRN] slow request osd_op(client.4361.0:53584 2.3 2:cee0b40c:::rbd_data.1131508c1732.0000000000005f53:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1404928~8192 in=8192b] snapc 0=[] RETRY=8 ondisk+retry+write+known_if_redirected e21) initiated 2020-11-01T22:46:07.255355+0000 currently waiting for sub ops" in cluster log Pass ================================================================= [5577169] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_deep_flatten} time: 00:11:19 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577169/ [5577170] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:27:56 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577170/ [5577171] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_fio} time: 00:40:08 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577171/ [5577172] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_data_pool} time: 00:23:31 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577172/ [5577174] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_fio} time: 01:15:39 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577174/ [5577175] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} time: 00:09:47 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577175/ [5577176] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_pages_required} time: 00:09:32 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577176/ [5577177] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_exclusive_option} time: 00:13:36 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577177/ [5577178] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:29:19 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577178/ [5577179] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:18:40 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577179/ [5577180] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_fallocate} time: 00:12:24 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577180/ [5577181] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:28:50 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577181/ [5577182] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_huge_osdmap} time: 00:12:32 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577182/ [5577183] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:53:05 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577183/ [5577184] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:15:31 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577184/ [5577185] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_discard} time: 00:11:30 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577185/ [5577186] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:24:16 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577186/ [5577187] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:15:09 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577187/ [5577188] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_namespaces} time: 00:14:36 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577188/ [5577189] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:33:09 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577189/ [5577190] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:29:33 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577190/ [5577191] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_enumerate} time: 00:30:33 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577191/ [5577192] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:17:35 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577192/ [5577193] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:27:43 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577193/ [5577194] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:11:45 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577194/ [5577195] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netns} time: 00:12:02 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577195/ [5577196] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_huge_image} time: 00:09:26 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577196/ [5577197] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:26:42 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577197/ [5577198] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 01:35:08 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577198/ [5577199] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_symlinks} time: 00:13:12 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577199/ [5577200] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:11:49 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577200/ [5577201] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:29:15 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577201/ [5577202] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_concurrent} time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577202/ [5577203] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_huge_tickets} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577203/ [5577204] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:27:41 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577204/ [5577205] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:20:12 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577205/ [5577206] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} time: 00:09:59 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577206/ [5577207] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} time: 00:28:41 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577207/ [5577208] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_image_read} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577208/ [5577209] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_modprobe} time: 00:09:48 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577209/ [5577210] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:27:06 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577210/ [5577211] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:56:37 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577211/ [5577212] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_kernel} time: 00:11:02 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577212/ [5577213] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:14:21 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577213/ [5577214] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:10:37 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577214/ [5577215] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577215/ [5577216] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_unmap} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577216/ [5577217] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577217/ [5577218] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:29:31 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577218/ [5577219] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_simple_big} time: 00:40:37 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577219/ [5577220] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_msgr_segments} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577220/ [5577221] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:28:31 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577221/ [5577222] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_fio} time: 00:40:48 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577222/ [5577223] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_data_pool} time: 00:33:00 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577223/ [5577225] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 02:07:52 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577225/ [5577226] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_exclusive_option} time: 00:13:54 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577226/ [5577227] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:25:36 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577227/ [5577228] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:18:30 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577228/ [5577229] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_fallocate} time: 00:12:50 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577229/ [5577231] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_huge_osdmap} time: 00:12:09 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577231/ [5577232] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:47:33 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577232/ [5577233] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_latest_osdmap_on_map} time: 00:15:58 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577233/ [5577234] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_parent_overlap} time: 00:09:30 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577234/ [5577235] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577235/ [5577236] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} time: 01:30:57 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577236/ [5577237] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_namespaces} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577237/ [5577238] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:32:26 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577238/ [5577239] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:16:13 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577239/ [5577240] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577240/ [5577241] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} time: 00:23:31 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577241/ [5577243] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577243/ [5577244] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:28:25 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577244/ [5577245] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:11:44 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577245/ [5577246] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netns} time: 00:11:55 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577246/ [5577247] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_read_only} time: 00:10:32 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577247/ [5577248] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:26:24 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577248/ [5577249] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:41:31 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577249/ [5577250] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_symlinks} time: 00:13:13 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577250/ [5577251] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:11:22 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577251/ [5577252] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:36:53 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577252/ [5577254] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_huge_tickets} time: 00:11:35 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577254/ [5577255] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:31:46 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577255/ [5577256] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:20:34 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577256/ [5577257] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_image_read} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577257/ [5577258] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_whole_object_zeroout} time: 00:10:20 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577258/ [5577259] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:24:46 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577259/ [5577260] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_fio} time: 01:14:08 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577260/ [5577261] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_kernel} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577261/ [5577262] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577262/ [5577263] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:11:09 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577263/ [5577264] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:28:32 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577264/ [5577265] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_unmap} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577265/ [5577266] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:10:56 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577266/ [5577267] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:28:05 info: http://pulpito.ceph.com/teuthology-2020-10-31_03:20:03-krbd-master-testing-basic-smithi/5577267/