2023-12-02T01:17:59.836 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-02T01:17:59.837 INFO:teuthology.results:subset: '111/12000' 2023-12-02T01:17:59.837 INFO:teuthology.results:seed: '516' 2023-12-02T01:52:20.172 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-02T01:52:20.197 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-12-02T03:23:27.421 INFO:teuthology.results:Tests finished! gathering results... 2023-12-02T03:23:28.676 INFO:scrape:Found 16 jobs 2023-12-02T03:23:29.462 INFO:scrape:Found 1 distinct failure reasons 2023-12-02T03:23:29.463 INFO:scrape:Failure: Command failed (workunit test suites/fsx.sh) on smithi023 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bed7681480ccb0192b91a35e691658867e1e96b7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' 2023-12-02T03:23:29.463 INFO:scrape:1 jobs: ['7474719'] 2023-12-02T03:23:29.463 INFO:scrape:suites: ['ignorelist_health', 'objectstore/bluestore-low-osd-mem-target', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-distros/centos_latest', 'tasks/cfuse_workunit_suites_fsx', 'thrashosds-health}'] 2023-12-02T03:23:29.463 INFO:scrape: 2023-12-02T03:23:29.464 INFO:teuthology.results:Sending results to yweinste@redhat.com: Test Run: yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi ================================================================= info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/ failed: 1 dead: 0 running: 0 waiting: 0 queued: 0 passed: 15 Fail ================================================================= [7474719] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} ----------------------------------------------------------------- time: 00:14:10 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474719/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474719/ sentry: https://sentry.ceph.com/organizations/ceph/?query=173bc69862c94a8aa7ca7ae9f063dfad Command failed (workunit test suites/fsx.sh) on smithi023 with status 2: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bed7681480ccb0192b91a35e691658867e1e96b7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsx.sh' Pass ================================================================= [7474705] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/ubuntu_latest tasks/snaps-few-objects thrashosds-health} time: 00:32:09 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474705/ [7474707] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/centos_latest tasks/snaps-many-objects thrashosds-health} time: 00:24:51 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474707/ [7474709] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health} time: 00:18:33 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474709/ [7474711] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health} time: 00:40:45 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474711/ [7474713] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_misc thrashosds-health} time: 00:42:36 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474713/ [7474715] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_ffsb thrashosds-health} time: 00:26:48 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474715/ [7474717] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} time: 00:17:24 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474717/ [7474721] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_fsync thrashosds-health} time: 00:17:37 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474721/ [7474723] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-distros/centos_latest tasks/cfuse_workunit_suites_pjd thrashosds-health} time: 00:15:48 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474723/ [7474725] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-distros/ubuntu_latest tasks/cfuse_workunit_suites_truncate_delay thrashosds-health} time: 00:14:18 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474725/ [7474727] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-distros/centos_latest tasks/rados_api_tests thrashosds-health} time: 00:29:14 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474727/ [7474728] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-distros/ubuntu_latest tasks/radosbench thrashosds-health} time: 01:27:12 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474728/ [7474730] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-distros/centos_latest tasks/readwrite thrashosds-health} time: 00:17:11 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474730/ [7474732] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-distros/ubuntu_latest tasks/snaps-few-objects thrashosds-health} time: 00:34:00 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474732/ [7474734] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-distros/centos_latest tasks/snaps-many-objects thrashosds-health} time: 00:25:11 info: https://pulpito.ceph.com/yuriw-2023-12-01_18:01:06-powercycle-main-distro-default-smithi/7474734/