2021-11-27T01:49:57.350 INFO:root:teuthology version: 1.1.0-a0bc3188
2021-11-27T01:49:57.353 INFO:teuthology.results:subset: '111/120000'
2021-11-27T01:49:57.353 INFO:teuthology.results:seed: '4461'
2021-11-27T02:37:50.862 INFO:root:teuthology version: 1.1.0-a0bc3188
2021-11-27T02:37:50.898 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-11-27T02:59:52.675 INFO:teuthology.results:Tests finished! gathering results...
2021-11-27T02:59:57.394 INFO:scrape:Found 63 jobs
2021-11-27T02:59:57.396 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/ideepika-2021-11-27_01:48:17-krbd-pacific-16.2.7_RC1-distro-default-smithi/6529986/teuthology.log
2021-11-27T03:00:14.989 INFO:scrape:Found 23 distinct failure reasons
2021-11-27T03:00:14.990 INFO:scrape:Dead: None
2021-11-27T03:00:14.991 INFO:scrape:3 jobs: ['6529986', '6529977', '6530012']
2021-11-27T03:00:14.991 INFO:scrape:
2021-11-27T03:00:14.992 INFO:scrape:Failure: Command failed on smithi082 with status 1: 'CEPH_REF=master CEPH_ID="0" PATH=$PATH:/usr/sbin adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /home/ubuntu/cephtest/virtualenv/bin/cram -v -- /home/ubuntu/cephtest/archive/cram.client.0/*.t'
2021-11-27T03:00:14.993 INFO:scrape:27 jobs: ['6530026', '6530008', '6529984', '6530006', '6530003', '6530032', '6529989', '6529974', '6530014', '6529982', '6530028', '6529979', '6530002', '6530025', '6529980', '6529995', '6529999', '6530022', '6529993', '6530016', '6530021', '6530020', '6530029', '6529973', '6530004', '6530010', '6529990']
2021-11-27T03:00:14.993 INFO:scrape:suites intersection: ['conf']
2021-11-27T03:00:14.994 INFO:scrape:suites union: ['ceph/ceph', 'clusters/fixed-1', 'clusters/fixed-3', 'conf', 'krbd/basic/{bluestore-bitmap', 'krbd/rbd/{bluestore-bitmap', 'krbd/singleton/{bluestore-bitmap', 'krbd/thrash/{bluestore-bitmap', 'ms_mode$/{legacy}', 'ms_mode$/{prefer-crc}', 'ms_mode$/{secure}', 'ms_mode/crc', 'ms_mode/legacy', 'ms_mode/secure', 'msgr-failures/few', 'msgr-failures/many', 'tasks/krbd_deep_flatten}', 'tasks/krbd_discard}', 'tasks/krbd_huge_image}', 'tasks/krbd_modprobe}', 'tasks/krbd_msgr_segments}', 'tasks/krbd_parent_overlap}', 'tasks/krbd_read_only}', 'tasks/krbd_whole_object_zeroout}', 'tasks/rbd_workunit_kernel_untar_build}', 'tasks/rbd_workunit_suites_dbench}', 'tasks/rbd_workunit_suites_ffsb}', 'tasks/rbd_workunit_suites_fsstress_ext4}', 'tasks/rbd_workunit_suites_fsstress}', 'tasks/rbd_workunit_suites_fsx}', 'tasks/rbd_workunit_suites_iozone}', 'tasks/rbd_workunit_trivial_sync}', 'tasks/rbd_xfstests}', 'thrashers/backoff', 'thrashers/mon-thrasher', 'thrashers/pggrow', 'thrashers/upmap', 'thrashosds-health', 'workloads/rbd_workunit_suites_ffsb}']
2021-11-27T03:00:14.994 INFO:scrape:
2021-11-27T03:00:14.995 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_huge_osdmap.sh) on smithi158 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_huge_osdmap.sh'
2021-11-27T03:00:14.996 INFO:scrape:1 jobs: ['6529992']
2021-11-27T03:00:14.996 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/few', 'tasks/krbd_huge_osdmap}']
2021-11-27T03:00:14.996 INFO:scrape:
2021-11-27T03:00:14.997 INFO:scrape:Failure: Command failed (workunit test rbd/kernel.sh) on smithi146 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/kernel.sh'
2021-11-27T03:00:14.997 INFO:scrape:2 jobs: ['6530024', '6529972']
2021-11-27T03:00:14.998 INFO:scrape:suites intersection: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'tasks/rbd_kernel}']
2021-11-27T03:00:14.998 INFO:scrape:suites union: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc', 'ms_mode/legacy', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_kernel}']
2021-11-27T03:00:14.999 INFO:scrape:
2021-11-27T03:00:14.999 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_latest_osdmap_on_map.sh) on smithi175 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_latest_osdmap_on_map.sh'
2021-11-27T03:00:14.999 INFO:scrape:1 jobs: ['6530000']
2021-11-27T03:00:15.000 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc', 'msgr-failures/many', 'tasks/krbd_latest_osdmap_on_map}']
2021-11-27T03:00:15.000 INFO:scrape:
2021-11-27T03:00:15.001 INFO:scrape:Failure: Command failed on smithi169 with status 91: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 1 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K pool_client.1 image_client.1'
2021-11-27T03:00:15.001 INFO:scrape:1 jobs: ['6530011']
2021-11-27T03:00:15.002 INFO:scrape:suites: ['clusters/3-node', 'conf', 'features/no-object-map', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{legacy}', 'objectstore/filestore-xfs', 'randomized-striping-on}', 'striping/fancy/{msgr-failures/few', 'tasks/fsx-3-client}']
2021-11-27T03:00:15.002 INFO:scrape:
2021-11-27T03:00:15.003 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_udev_netlink_enobufs.sh) on smithi186 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_netlink_enobufs.sh'
2021-11-27T03:00:15.003 INFO:scrape:1 jobs: ['6530007']
2021-11-27T03:00:15.003 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc', 'msgr-failures/few', 'tasks/krbd_udev_netlink_enobufs}']
2021-11-27T03:00:15.004 INFO:scrape:
2021-11-27T03:00:15.004 INFO:scrape:Failure: Command failed on smithi149 with status 22: 'sudo rbd device map -o queue_depth=256 i2flayering-exclusive-locksmithi149'
2021-11-27T03:00:15.005 INFO:scrape:4 jobs: ['6529971', '6529985', '6529996', '6529987']
2021-11-27T03:00:15.005 INFO:scrape:suites intersection: ['clusters/fixed-3', 'conf']
2021-11-27T03:00:15.006 INFO:scrape:suites union: ['ceph/ceph', 'clusters/fixed-3', 'conf', 'krbd/rbd/{bluestore-bitmap', 'krbd/thrash/{bluestore-bitmap', 'ms_mode$/{crc}', 'ms_mode$/{legacy}', 'ms_mode$/{prefer-crc}', 'ms_mode/secure', 'msgr-failures/many', 'tasks/rbd_fio}', 'thrashers/backoff', 'thrashers/mon-thrasher', 'thrashers/upmap', 'thrashosds-health', 'workloads/rbd_fio}']
2021-11-27T03:00:15.006 INFO:scrape:
2021-11-27T03:00:15.006 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_udev_symlinks.sh) on smithi092 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_symlinks.sh'
2021-11-27T03:00:15.007 INFO:scrape:1 jobs: ['6530013']
2021-11-27T03:00:15.007 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/few', 'tasks/krbd_udev_symlinks}']
2021-11-27T03:00:15.008 INFO:scrape:
2021-11-27T03:00:15.008 INFO:scrape:Failure: Command failed (workunit test rbd/map-snapshot-io.sh) on smithi109 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/map-snapshot-io.sh'
2021-11-27T03:00:15.009 INFO:scrape:1 jobs: ['6530030']
2021-11-27T03:00:15.009 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/legacy', 'msgr-failures/many', 'tasks/rbd_map_snapshot_io}']
2021-11-27T03:00:15.009 INFO:scrape:
2021-11-27T03:00:15.010 INFO:scrape:Failure: Command failed (workunit test rbd/map-unmap.sh) on smithi121 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/map-unmap.sh'
2021-11-27T03:00:15.010 INFO:scrape:2 jobs: ['6529978', '6530031']
2021-11-27T03:00:15.011 INFO:scrape:suites intersection: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'tasks/rbd_map_unmap}']
2021-11-27T03:00:15.011 INFO:scrape:suites union: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc', 'ms_mode/secure', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_map_unmap}']
2021-11-27T03:00:15.012 INFO:scrape:
2021-11-27T03:00:15.012 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_udev_enumerate.sh) on smithi145 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_enumerate.sh'
2021-11-27T03:00:15.013 INFO:scrape:1 jobs: ['6530005']
2021-11-27T03:00:15.013 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/secure', 'msgr-failures/many', 'tasks/krbd_udev_enumerate}']
2021-11-27T03:00:15.013 INFO:scrape:
2021-11-27T03:00:15.014 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_exclusive_option.sh) on smithi179 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_exclusive_option.sh'
2021-11-27T03:00:15.014 INFO:scrape:1 jobs: ['6529988']
2021-11-27T03:00:15.015 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc', 'msgr-failures/few', 'tasks/krbd_exclusive_option}']
2021-11-27T03:00:15.015 INFO:scrape:
2021-11-27T03:00:15.016 INFO:scrape:Failure: Command failed (workunit test rbd/huge-tickets.sh) on smithi149 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/huge-tickets.sh'
2021-11-27T03:00:15.016 INFO:scrape:1 jobs: ['6530019']
2021-11-27T03:00:15.016 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/legacy', 'msgr-failures/few', 'tasks/rbd_huge_tickets}']
2021-11-27T03:00:15.017 INFO:scrape:
2021-11-27T03:00:15.017 INFO:scrape:Failure: "2021-11-27T02:51:37.727164+0000 mon.a (mon.0) 157 : cluster [WRN] Health check failed: 0 slow ops, oldest one blocked for 30 sec, osd.5 has slow ops (SLOW_OPS)" in cluster log
2021-11-27T03:00:15.018 INFO:scrape:1 jobs: ['6530015']
2021-11-27T03:00:15.018 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc', 'msgr-failures/many', 'tasks/rbd_concurrent}']
2021-11-27T03:00:15.019 INFO:scrape:
2021-11-27T03:00:15.019 INFO:scrape:Failure: Command failed on smithi115 with status 91: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 1 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 512 -w 512 -t 512 -h 512 -l 250000000 -S 0 -N 10000 -K -U pool_client.1 image_client.1'
2021-11-27T03:00:15.019 INFO:scrape:3 jobs: ['6529981', '6530027', '6529994']
2021-11-27T03:00:15.020 INFO:scrape:suites intersection: ['clusters/3-node', 'conf', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'objectstore/bluestore-bitmap', 'randomized-striping-off}']
2021-11-27T03:00:15.020 INFO:scrape:suites union: ['clusters/3-node', 'conf', 'features/object-map', 'krbd/fsx/{ceph/ceph', 'ms_mode$/{crc}', 'ms_mode$/{legacy}', 'ms_mode$/{secure}', 'objectstore/bluestore-bitmap', 'randomized-striping-off}', 'striping/default/{msgr-failures/few', 'striping/default/{msgr-failures/many', 'tasks/fsx-1-client}', 'tasks/fsx-3-client}']
2021-11-27T03:00:15.021 INFO:scrape:
2021-11-27T03:00:15.021 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=nightly_pre-single-major
2021-11-27T03:00:15.022 INFO:scrape:1 jobs: ['6529997']
2021-11-27T03:00:15.022 INFO:scrape:suites: ['clusters/separate-client', 'conf', 'filestore-xfs', 'kernels/pre-single-major', 'krbd/unmap/{ceph/ceph', 'tasks/unmap}']
2021-11-27T03:00:15.022 INFO:scrape:
2021-11-27T03:00:15.023 INFO:scrape:Failure: Command failed (workunit test rbd/image_read.sh) on smithi183 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/image_read.sh'
2021-11-27T03:00:15.023 INFO:scrape:2 jobs: ['6529970', '6530023']
2021-11-27T03:00:15.024 INFO:scrape:suites intersection: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'tasks/rbd_image_read}']
2021-11-27T03:00:15.024 INFO:scrape:suites union: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/crc', 'ms_mode/secure', 'msgr-failures/few', 'msgr-failures/many', 'tasks/rbd_image_read}']
2021-11-27T03:00:15.025 INFO:scrape:
2021-11-27T03:00:15.025 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_fallocate.sh) on smithi140 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_fallocate.sh'
2021-11-27T03:00:15.025 INFO:scrape:1 jobs: ['6529991']
2021-11-27T03:00:15.026 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/legacy', 'msgr-failures/many', 'tasks/krbd_fallocate}']
2021-11-27T03:00:15.026 INFO:scrape:
2021-11-27T03:00:15.027 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_namespaces.sh) on smithi192 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_namespaces.sh'
2021-11-27T03:00:15.027 INFO:scrape:1 jobs: ['6530001']
2021-11-27T03:00:15.028 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/legacy', 'msgr-failures/few', 'tasks/krbd_namespaces}']
2021-11-27T03:00:15.028 INFO:scrape:
2021-11-27T03:00:15.028 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_udev_netns.sh) on smithi204 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_udev_netns.sh'
2021-11-27T03:00:15.029 INFO:scrape:1 jobs: ['6530009']
2021-11-27T03:00:15.029 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/legacy', 'msgr-failures/many', 'tasks/krbd_udev_netns}']
2021-11-27T03:00:15.030 INFO:scrape:
2021-11-27T03:00:15.030 INFO:scrape:Failure: Command failed (workunit test rbd/krbd_stable_writes.sh) on smithi059 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/krbd_stable_writes.sh'
2021-11-27T03:00:15.031 INFO:scrape:1 jobs: ['6529998']
2021-11-27T03:00:15.031 INFO:scrape:suites: ['ceph/ceph', 'clusters/fixed-1', 'conf', 'krbd/wac/sysfs/{bluestore-bitmap', 'tasks/stable_writes}']
2021-11-27T03:00:15.031 INFO:scrape:
2021-11-27T03:00:15.032 INFO:scrape:Failure: Command failed (workunit test rbd/simple_big.sh) on smithi092 with status 22: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fdc003bc12f1b2443c4596eeacb32cf62e806970 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/simple_big.sh'
2021-11-27T03:00:15.032 INFO:scrape:1 jobs: ['6529983']
2021-11-27T03:00:15.033 INFO:scrape:suites: ['clusters/fixed-3', 'conf', 'install/ceph', 'krbd/rbd-nomount/{bluestore-bitmap', 'ms_mode/legacy', 'msgr-failures/few', 'tasks/rbd_simple_big}']
2021-11-27T03:00:15.033 INFO:scrape: