2022-03-16T11:15:36.413 INFO:root:teuthology version: 1.1.0-fbfc7b38 2022-03-16T11:15:36.414 INFO:teuthology.results:subset: '18984/100000' 2022-03-16T11:15:36.414 INFO:teuthology.results:seed: '8724' 2022-03-16T11:27:39.122 INFO:root:teuthology version: 1.1.0-fbfc7b38 2022-03-16T11:27:39.127 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-03-16T13:05:45.419 INFO:teuthology.results:Tests finished! gathering results... 2022-03-16T13:05:46.140 INFO:scrape:Found 15 jobs 2022-03-16T13:05:46.711 INFO:scrape:Found 2 distinct failure reasons 2022-03-16T13:05:46.711 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi151.front.sepia.ceph.com: ['type=AVC msg=audit(1647431963.912:43): avc: denied { node_bind } for pid=1603 comm="ping" saddr=172.21.15.151 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647431550.814:42): avc: denied { node_bind } for pid=1601 comm="ping" saddr=172.21.15.151 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647431330.147:41): avc: denied { node_bind } for pid=1618 comm="ping" saddr=172.21.15.151 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2022-03-16T13:05:46.712 INFO:scrape:5 jobs: ['6739121', '6739115', '6739118', '6739109', '6739112'] 2022-03-16T13:05:46.712 INFO:scrape:suites intersection: ['powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'thrashosds-health', 'whitelist_health}'] 2022-03-16T13:05:46.713 INFO:scrape:suites union: ['objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-stupid', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/cfuse_workunit_kernel_untar_build', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_pjd', 'tasks/radosbench', 'tasks/snaps-many-objects', 'thrashosds-health', 'whitelist_health}'] 2022-03-16T13:05:46.713 INFO:scrape: 2022-03-16T13:05:46.714 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ccf6db7f29f65466de9f1a9c2001ac8d9c8d2ab TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 2022-03-16T13:05:46.714 INFO:scrape:1 jobs: ['6739117'] 2022-03-16T13:05:46.714 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/ubuntu_latest', 'tasks/rados_api_tests', 'thrashosds-health', 'whitelist_health}'] 2022-03-16T13:05:46.715 INFO:scrape: 2022-03-16T13:05:46.716 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 9 Fail ================================================================= [6739109] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:54:15 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739109/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739109/ SELinux denials found on ubuntu@smithi173.front.sepia.ceph.com: ['type=AVC msg=audit(1647431799.759:42): avc: denied { node_bind } for pid=1599 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647431386.025:42): avc: denied { node_bind } for pid=1618 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647430771.993:41): avc: denied { node_bind } for pid=1654 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647431002.880:43): avc: denied { node_bind } for pid=1619 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647431634.985:43): avc: denied { node_bind } for pid=1597 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6739112] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:18:37 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739112/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739112/ SELinux denials found on ubuntu@smithi197.front.sepia.ceph.com: ['type=AVC msg=audit(1647430536.916:41): avc: denied { node_bind } for pid=1813 comm="ping" saddr=172.21.15.197 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6739115] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:15:43 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739115/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739115/ SELinux denials found on ubuntu@smithi049.front.sepia.ceph.com: ['type=AVC msg=audit(1647430664.847:42): avc: denied { node_bind } for pid=1825 comm="ping" saddr=172.21.15.49 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6739117] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 01:00:01 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739117/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739117/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5f3427f9e4cc4f6f815fd4f979b424bf Command failed (workunit test rados/test.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1ccf6db7f29f65466de9f1a9c2001ac8d9c8d2ab TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' [6739118] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/radosbench thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 01:39:58 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739118/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739118/ SELinux denials found on ubuntu@smithi107.front.sepia.ceph.com: ['type=AVC msg=audit(1647434654.868:42): avc: denied { node_bind } for pid=1604 comm="ping" saddr=172.21.15.107 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647434959.433:43): avc: denied { node_bind } for pid=1588 comm="ping" saddr=172.21.15.107 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647434345.943:43): avc: denied { node_bind } for pid=1596 comm="ping" saddr=172.21.15.107 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6739121] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/snaps-many-objects thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:26:48 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739121/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739121/ SELinux denials found on ubuntu@smithi151.front.sepia.ceph.com: ['type=AVC msg=audit(1647431963.912:43): avc: denied { node_bind } for pid=1603 comm="ping" saddr=172.21.15.151 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647431550.814:42): avc: denied { node_bind } for pid=1601 comm="ping" saddr=172.21.15.151 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1647431330.147:41): avc: denied { node_bind } for pid=1618 comm="ping" saddr=172.21.15.151 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] Pass ================================================================= [6739108] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739108/ [6739110] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 00:38:20 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739110/ [6739111] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 00:44:23 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739111/ [6739113] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:31:27 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739113/ [6739114] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:12:34 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739114/ [6739116] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:15:07 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739116/ [6739119] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8 tasks/readwrite thrashosds-health whitelist_health} time: 00:20:40 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739119/ [6739120] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:26:51 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739120/ [6739122] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:18:02 info: http://pulpito.ceph.com/teuthology-2022-03-16_11:15:03-powercycle-quincy-distro-default-smithi/6739122/