2021-09-15T12:17:29.987 INFO:root:teuthology version: 1.1.0-b135a4f8 2021-09-15T12:17:29.989 INFO:teuthology.results:subset: '275/9999' 2021-09-15T12:17:29.989 INFO:teuthology.results:seed: '6229' 2021-09-15T12:17:43.767 INFO:root:teuthology version: 1.1.0-b135a4f8 2021-09-15T12:17:43.771 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-09-15T13:52:49.416 INFO:teuthology.results:Tests finished! gathering results... 2021-09-15T13:52:49.833 INFO:scrape:Found 15 jobs 2021-09-15T13:52:49.835 INFO:scrape:Found 2 distinct failure reasons 2021-09-15T13:52:49.836 INFO:scrape:Failure: reached maximum tries (150) after waiting for 900 seconds 2021-09-15T13:52:49.836 INFO:scrape:1 jobs: ['6390706'] 2021-09-15T13:52:49.837 INFO:scrape:suites: ['objectstore/bluestore-comp-snappy', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/cfuse_workunit_suites_ffsb', 'thrashosds-health', 'whitelist_health}'] 2021-09-15T13:52:49.837 INFO:scrape: 2021-09-15T13:52:49.837 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi052 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4ab8789ac8c6826e54b8997ace4e68c0863fe1f5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2021-09-15T13:52:49.838 INFO:scrape:1 jobs: ['6390712'] 2021-09-15T13:52:49.838 INFO:scrape:suites: ['objectstore/filestore-xfs', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/rados_api_tests', 'thrashosds-health', 'whitelist_health}'] 2021-09-15T13:52:49.838 INFO:scrape: 2021-09-15T13:52:49.839 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/ failed: 2 dead: 0 running: 0 waiting: 0 queued: 0 passed: 13 Fail ================================================================= [6390706] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:43:51 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390706/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390706/ reached maximum tries (150) after waiting for 900 seconds [6390712] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:35:23 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390712/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390712/ sentry: https://sentry.ceph.com/organizations/ceph/?query=e4f020ba7e7e48db94997ee24dcf78df Command failed (workunit test rados/test.sh) on smithi052 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4ab8789ac8c6826e54b8997ace4e68c0863fe1f5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' Pass ================================================================= [6390698] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/rados_api_tests thrashosds-health whitelist_health} time: 00:38:00 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390698/ [6390699] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/radosbench thrashosds-health whitelist_health} time: 01:21:37 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390699/ [6390700] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/readwrite thrashosds-health whitelist_health} time: 00:18:21 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390700/ [6390701] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:35:09 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390701/ [6390702] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:26:36 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390702/ [6390703] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:16:15 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390703/ [6390704] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 00:43:18 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390704/ [6390705] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 00:41:55 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390705/ [6390707] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:20:46 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390707/ [6390708] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:22:42 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390708/ [6390709] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:16:30 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390709/ [6390710] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:19:13 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390710/ [6390711] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:11:41 info: http://pulpito.ceph.com/teuthology-2021-09-15_12:17:02-powercycle-pacific-distro-basic-smithi/6390711/