2023-06-30T07:40:19.877 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39 2023-06-30T07:40:19.878 INFO:teuthology.results:subset: '23/256' 2023-06-30T07:40:19.878 INFO:teuthology.results:seed: '3567' 2023-06-30T07:40:28.289 INFO:root:teuthology version: 0.0.1.dev134+ge25bf39 2023-06-30T07:40:28.290 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-06-30T10:39:40.373 INFO:teuthology.results:Tests finished! gathering results... 2023-06-30T10:39:41.298 INFO:scrape:Found 11 jobs 2023-06-30T10:39:41.347 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/rishabh-2023-06-30_07:40:12-fs-wip-rishabh-readdir-testing-default-smithi/7322365/teuthology.log 2023-06-30T10:39:42.995 INFO:scrape:Found 5 distinct failure reasons 2023-06-30T10:39:42.996 INFO:scrape:Dead: None 2023-06-30T10:39:42.996 INFO:scrape:2 jobs: ['7322365', '7322359'] 2023-06-30T10:39:42.996 INFO:scrape: 2023-06-30T10:39:42.997 INFO:scrape:Failure: error during scrub thrashing: reached maximum tries (31) after waiting for 900 seconds 2023-06-30T10:39:42.997 INFO:scrape:1 jobs: ['7322367'] 2023-06-30T10:39:42.997 INFO:scrape:suites: ['1-cephadm', '1-check-counter', '2-logrotate}', '2-scrub/yes', '3-snaps/yes', '4-flush/no', '5-workunit/kernel_untar_build}}', 'begin/{0-install', 'clusters/1a11s-mds-1c-client-3node', 'conf/{client', 'frag', 'fs/workload/{0-rhel_8', 'ignorelist_health', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'n/5', 'objectstore-ec/bluestore-comp', 'omap_limit/10', 'osd-asserts', 'osd}', 'overrides/{cephsqlite-timeout', 'ranks/multi/{export-check', 'replication/always}', 'session_timeout}', 'standby-replay', 'tasks/{0-subvolume/{with-namespace-isolated-and-quota}'] 2023-06-30T10:39:42.998 INFO:scrape: 2023-06-30T10:39:42.998 INFO:scrape:Failure: Test failure: test_pool_perm (tasks.cephfs.test_pool_perm.TestPoolPerm) 2023-06-30T10:39:42.998 INFO:scrape:1 jobs: ['7322364'] 2023-06-30T10:39:42.998 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{centos_8}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount/fuse', 'no_client_pidfile}', 'objectstore/bluestore-ec-root', 'osd}', 'overrides/{ignorelist_health', 'tasks/pool-perm}'] 2023-06-30T10:39:42.999 INFO:scrape: 2023-06-30T10:39:42.999 INFO:scrape:Failure: Command failed (workunit test fs/quota/quota.sh) on smithi173 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8d469929ce71a4a5c522ffde4447daa89fd6f4d6 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' 2023-06-30T10:39:42.999 INFO:scrape:1 jobs: ['7322368'] 2023-06-30T10:39:43.000 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1a3s-mds-4c-client', 'conf/{client', 'distro/{ubuntu_latest}', 'fs/functional/{begin/{0-install', 'ignorelist_wrongly_marked_down', 'mds', 'mon', 'mount', 'mount/kclient/{mount-syntax/{v1}', 'ms-die-on-skipped}}', 'no_client_pidfile}', 'objectstore/bluestore-bitmap', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{ignorelist_health', 'rhel_8}', 'tasks/workunit/quota}'] 2023-06-30T10:39:43.000 INFO:scrape: 2023-06-30T10:39:43.000 INFO:scrape:Failure: Command failed on smithi105 with status 2: 'sudo dpkg -i /tmp/linux-image.deb' 2023-06-30T10:39:43.000 INFO:scrape:1 jobs: ['7322361'] 2023-06-30T10:39:43.001 INFO:scrape:suites: ['1-ceph', '2-logrotate}', 'clusters/1-mds-3-client', 'conf/{client', 'distros/ubuntu_latest', 'fs/multiclient/{begin/{0-install', 'ignorelist_wrongly_marked_down}', 'mds', 'mon', 'mount/fuse', 'objectstore-ec/bluestore-bitmap', 'osd}', 'overrides/{ignorelist_health', 'tasks/mdtest}'] 2023-06-30T10:39:43.001 INFO:scrape: