2021-01-01T11:36:19.722 INFO:root:teuthology version: 1.0.0-8e49dda4 2021-01-01T11:36:19.724 INFO:teuthology.results:seed: '1909' 2021-01-01T12:58:47.029 INFO:root:teuthology version: 1.0.0-8e49dda4 2021-01-01T12:58:47.062 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-01-01T21:14:57.473 INFO:teuthology.results:Tests finished! gathering results... 2021-01-01T21:15:33.319 INFO:scrape:Found 100 jobs 2021-01-01T21:15:48.199 INFO:scrape:Found 5 distinct failure reasons 2021-01-01T21:15:48.200 INFO:scrape:Failure: Command failed on smithi080 with status 4: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludecxj309wy -r -- '-g auto -g blockdev -x clone'" 2021-01-01T21:15:48.200 INFO:scrape:2 jobs: ['5740094', '5740043'] 2021-01-01T21:15:48.201 INFO:scrape:suites intersection: ['conf', 'krbd/singleton/{bluestore-bitmap', 'tasks/rbd_xfstests}'] 2021-01-01T21:15:48.201 INFO:scrape:suites union: ['conf', 'krbd/singleton/{bluestore-bitmap', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_xfstests}'] 2021-01-01T21:15:48.202 INFO:scrape: 2021-01-01T21:15:48.202 INFO:scrape:Failure: "2021-01-01T15:10:00.000225+0000 mon.a (mon.0) 451 : cluster [WRN] overall HEALTH_WARN Slow OSD heartbeats on back (longest 2011.513ms); Slow OSD heartbeats on front (longest 1936.964ms)" in cluster log 2021-01-01T21:15:48.202 INFO:scrape:1 jobs: ['5740108'] 2021-01-01T21:15:48.203 INFO:scrape:suites: ['clusters/3-node', 'conf', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'randomized-striping-on}', 'striping/fancy/{msgr-failures/few', 'tasks/fsx-1-client}'] 2021-01-01T21:15:48.203 INFO:scrape: 2021-01-01T21:15:48.204 INFO:scrape:Failure: "2021-01-01T13:29:45.043915+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.10333.0:4153829 2.7 2:e4035e0e:::rbd_header.20aef38b1b7:head [watch reconnect cookie 18446462598732840970 gen 22113] snapc 0=[] ondisk+write+known_if_redirected e21) initiated 2021-01-01T13:29:14.851360+0000 currently started" in cluster log 2021-01-01T21:15:48.204 INFO:scrape:1 jobs: ['5740123'] 2021-01-01T21:15:48.204 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'msgr-failures/many', 'tasks/rbd_concurrent}'] 2021-01-01T21:15:48.205 INFO:scrape: 2021-01-01T21:15:48.205 INFO:scrape:Failure: Command failed on smithi025 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 2021-01-01T21:15:48.206 INFO:scrape:1 jobs: ['5740059'] 2021-01-01T21:15:48.206 INFO:scrape:suites: ['clusters/3-node', 'conf', 'features/no-object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'randomized-striping-on}', 'striping/fancy/{msgr-failures/few', 'tasks/fsx-1-client}'] 2021-01-01T21:15:48.207 INFO:scrape: 2021-01-01T21:15:48.207 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/rbd/concurrent.sh 2021-01-01T21:15:48.207 INFO:scrape:1 jobs: ['5740072'] 2021-01-01T21:15:48.208 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'msgr-failures/few', 'tasks/rbd_concurrent}'] 2021-01-01T21:15:48.208 INFO:scrape: 2021-01-01T21:15:48.212 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 94 Fail ================================================================= [5740043] krbd/singleton/{bluestore-bitmap conf msgr-failures/few tasks/rbd_xfstests} ----------------------------------------------------------------- time: 09:19:35 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740043/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740043/ sentry: https://sentry.ceph.com/organizations/ceph/?query=cc44261aa30b49c98f57bc90ef3338bf Command failed on smithi156 with status 4: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excluderbdknpx8 -r -- '-g auto -g blockdev -x clone'" [5740059] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} ----------------------------------------------------------------- time: 07:53:52 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740059/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740059/ Command failed on smithi025 with status 123: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" [5740072] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_concurrent} ----------------------------------------------------------------- time: 03:18:24 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740072/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740072/ sentry: https://sentry.ceph.com/organizations/ceph/?query=82db95f6aaae42748d7261dec08f951b Command failed (workunit test rbd/concurrent.sh) on smithi031 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=3ef56c398ba628e9011753b67786b8e2a37447a6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/concurrent.sh' [5740094] krbd/singleton/{bluestore-bitmap conf msgr-failures/many tasks/rbd_xfstests} ----------------------------------------------------------------- time: 08:32:28 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740094/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740094/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aefa458c7f8946b7960b587e90cdab56 Command failed on smithi080 with status 4: "/usr/bin/sudo TESTDIR=/home/ubuntu/cephtest adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/bash /home/ubuntu/cephtest/run_xfstests.sh -c 1 -f ext4 -t /dev/rbd0 -s /dev/rbd1 -x /tmp/excludecxj309wy -r -- '-g auto -g blockdev -x clone'" [5740108] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} ----------------------------------------------------------------- time: 06:47:04 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740108/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740108/ "2021-01-01T15:10:00.000225+0000 mon.a (mon.0) 451 : cluster [WRN] overall HEALTH_WARN Slow OSD heartbeats on back (longest 2011.513ms); Slow OSD heartbeats on front (longest 1936.964ms)" in cluster log [5740123] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_concurrent} ----------------------------------------------------------------- time: 01:00:13 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740123/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740123/ "2021-01-01T13:29:45.043915+0000 osd.3 (osd.3) 3 : cluster [WRN] slow request osd_op(client.10333.0:4153829 2.7 2:e4035e0e:::rbd_header.20aef38b1b7:head [watch reconnect cookie 18446462598732840970 gen 22113] snapc 0=[] ondisk+write+known_if_redirected e21) initiated 2021-01-01T13:29:14.851360+0000 currently started" in cluster log Pass ================================================================= [5740039] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_deep_flatten} time: 00:16:48 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740039/ [5740040] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:30:14 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740040/ [5740041] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_fio} time: 00:40:39 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740041/ [5740042] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_data_pool} time: 00:28:05 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740042/ [5740044] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_fio} time: 01:23:32 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740044/ [5740045] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/pre-single-major tasks/unmap} time: 00:14:45 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740045/ [5740046] krbd/wac/sysfs/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/stable_writes} time: 00:14:37 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740046/ [5740047] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_exclusive_option} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740047/ [5740048] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:27:53 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740048/ [5740049] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_kernel_untar_build} time: 00:23:20 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740049/ [5740050] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_fallocate} time: 00:17:04 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740050/ [5740051] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:33:44 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740051/ [5740052] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_huge_osdmap} time: 00:17:34 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740052/ [5740053] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_dbench} time: 00:54:34 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740053/ [5740054] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_latest_osdmap_on_map} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740054/ [5740055] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_discard} time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740055/ [5740056] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:23:36 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740056/ [5740057] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:26:25 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740057/ [5740058] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_namespaces} time: 00:21:08 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740058/ [5740060] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_ffsb} time: 01:30:49 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740060/ [5740061] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_enumerate} time: 00:36:56 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740061/ [5740062] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netlink_enobufs} time: 00:22:37 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740062/ [5740063] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:27:02 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740063/ [5740064] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress} time: 00:16:08 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740064/ [5740065] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netns} time: 00:16:59 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740065/ [5740066] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_huge_image} time: 00:14:43 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740066/ [5740067] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:24:26 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740067/ [5740068] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_fio} time: 01:13:03 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740068/ [5740069] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_symlinks} time: 00:17:52 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740069/ [5740070] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress_ext4} time: 00:16:29 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740070/ [5740071] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:30:13 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740071/ [5740073] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_huge_tickets} time: 00:16:40 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740073/ [5740074] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:26:11 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740074/ [5740075] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsx} time: 00:24:51 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740075/ [5740076] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-off tasks/unmap} time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740076/ [5740077] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/many-resets} time: 00:28:31 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740077/ [5740078] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_image_read} time: 00:16:22 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740078/ [5740079] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_modprobe} time: 00:14:50 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740079/ [5740080] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:26:11 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740080/ [5740081] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 02:05:56 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740081/ [5740082] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_kernel} time: 00:15:51 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740082/ [5740083] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_iozone} time: 00:19:10 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740083/ [5740084] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_snapshot_io} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740084/ [5740085] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:32:54 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740085/ [5740086] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_unmap} time: 00:20:41 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740086/ [5740087] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_trivial_sync} time: 00:15:44 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740087/ [5740088] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:28:52 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740088/ [5740089] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_simple_big} time: 00:45:36 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740089/ [5740090] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_msgr_segments} time: 00:14:13 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740090/ [5740091] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:33:08 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740091/ [5740092] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_fio} time: 00:44:59 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740092/ [5740093] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_data_pool} time: 00:33:43 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740093/ [5740095] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/backoff thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:58:07 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740095/ [5740096] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_exclusive_option} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740096/ [5740097] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:27:37 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740097/ [5740098] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_kernel_untar_build} time: 00:23:09 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740098/ [5740099] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_fallocate} time: 00:17:48 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740099/ [5740100] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:36:20 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740100/ [5740101] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_huge_osdmap} time: 00:17:39 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740101/ [5740102] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_dbench} time: 00:54:07 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740102/ [5740103] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_latest_osdmap_on_map} time: 00:20:22 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740103/ [5740104] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_parent_overlap} time: 00:14:43 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740104/ [5740105] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:24:41 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740105/ [5740106] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/mon-thrasher thrashosds-health workloads/rbd_fio} time: 01:28:24 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740106/ [5740107] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_namespaces} time: 00:19:19 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740107/ [5740109] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_ffsb} time: 01:25:04 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740109/ [5740110] krbd/unmap/{ceph/ceph clusters/separate-client conf filestore-xfs kernels/single-major-on tasks/unmap} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740110/ [5740111] krbd/wac/wac/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf tasks/wac verify/no-resets} time: 00:28:09 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740111/ [5740112] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_enumerate} time: 00:51:39 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740112/ [5740113] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_netlink_enobufs} time: 00:22:45 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740113/ [5740114] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:21:56 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740114/ [5740115] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsstress} time: 00:16:21 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740115/ [5740116] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/krbd_udev_netns} time: 00:16:35 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740116/ [5740117] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_read_only} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740117/ [5740118] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-1-client} time: 00:28:44 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740118/ [5740119] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/pggrow thrashosds-health workloads/rbd_workunit_suites_ffsb} time: 01:38:49 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740119/ [5740120] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/krbd_udev_symlinks} time: 00:17:33 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740120/ [5740121] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_fsstress_ext4} time: 00:16:25 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740121/ [5740122] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-3-client} time: 00:32:09 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740122/ [5740124] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_huge_tickets} time: 00:16:09 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740124/ [5740125] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-1-client} time: 00:33:45 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740125/ [5740126] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_suites_fsx} time: 00:26:16 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740126/ [5740127] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_image_read} time: 00:16:44 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740127/ [5740128] krbd/basic/{bluestore-bitmap ceph/ceph clusters/fixed-1 conf tasks/krbd_whole_object_zeroout} time: 00:15:35 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740128/ [5740129] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/few randomized-striping-off} tasks/fsx-3-client} time: 00:24:44 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740129/ [5740130] krbd/thrash/{bluestore-bitmap ceph/ceph clusters/fixed-3 conf thrashers/upmap thrashosds-health workloads/rbd_fio} time: 01:17:56 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740130/ [5740131] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_kernel} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740131/ [5740132] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/few tasks/rbd_workunit_suites_iozone} time: 00:18:57 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740132/ [5740133] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_map_snapshot_io} time: 00:15:32 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740133/ [5740134] krbd/fsx/{ceph/ceph clusters/3-node conf features/object-map objectstore/filestore-xfs striping/fancy/{msgr-failures/few randomized-striping-on} tasks/fsx-1-client} time: 00:29:49 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740134/ [5740135] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/few tasks/rbd_map_unmap} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740135/ [5740136] krbd/rbd/{bluestore-bitmap clusters/fixed-3 conf msgr-failures/many tasks/rbd_workunit_trivial_sync} time: 00:16:25 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740136/ [5740137] krbd/fsx/{ceph/ceph clusters/3-node conf features/no-object-map objectstore/bluestore-bitmap striping/default/{msgr-failures/many randomized-striping-off} tasks/fsx-3-client} time: 00:28:44 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740137/ [5740138] krbd/rbd-nomount/{bluestore-bitmap clusters/fixed-3 conf install/ceph msgr-failures/many tasks/rbd_simple_big} time: 00:47:32 info: http://pulpito.ceph.com/teuthology-2020-12-28_03:20:02-krbd-master-testing-basic-smithi/5740138/