2022-04-13T15:41:26.605 INFO:root:teuthology version: 1.1.0-a347b2ac 2022-04-13T15:41:26.607 INFO:teuthology.results:subset: '1281/9999' 2022-04-13T15:41:26.607 INFO:teuthology.results:seed: '4263' 2022-04-15T06:43:44.987 INFO:root:teuthology version: 1.1.0-0e6dbbf1 2022-04-15T06:43:45.020 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-15T07:03:46.565 INFO:teuthology.results:Tests finished! gathering results... 2022-04-15T07:03:47.741 INFO:scrape:Found 15 jobs 2022-04-15T07:03:50.132 INFO:scrape:Found 3 distinct failure reasons 2022-04-15T07:03:50.132 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi176.front.sepia.ceph.com: ['type=AVC msg=audit(1650005991.712:41): avc: denied { node_bind } for pid=1809 comm="ping" saddr=172.21.15.176 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2022-04-15T07:03:50.132 INFO:scrape:4 jobs: ['6789957', '6789948', '6789945', '6789954'] 2022-04-15T07:03:50.133 INFO:scrape:suites intersection: ['powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'thrashosds-health', 'whitelist_health}'] 2022-04-15T07:03:50.133 INFO:scrape:suites union: ['objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/cfuse_workunit_suites_fsstress', 'tasks/cfuse_workunit_suites_pjd', 'tasks/rados_api_tests', 'tasks/snaps-few-objects', 'thrashosds-health', 'whitelist_health}'] 2022-04-15T07:03:50.133 INFO:scrape: 2022-04-15T07:03:50.133 INFO:scrape:Timeout 120 running ceph --cluster ceph osd dump --format=json 2022-04-15T07:03:50.133 INFO:scrape:1 jobs: ['6789947'] 2022-04-15T07:03:50.133 INFO:scrape:suites: ['objectstore/bluestore-comp-zstd', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/ubuntu_latest', 'tasks/readwrite', 'thrashosds-health', 'whitelist_health}'] 2022-04-15T07:03:50.133 INFO:scrape: 2022-04-15T07:03:50.133 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi138.front.sepia.ceph.com: ['type=AVC msg=audit(1649976288.980:41): avc: denied { node_bind } for pid=1665 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1649976790.914:43): avc: denied { node_bind } for pid=1588 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1649976943.730:41): avc: denied { node_bind } for pid=1594 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1649976445.669:43): avc: denied { node_bind } for pid=1596 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2022-04-15T07:03:50.134 INFO:scrape:1 jobs: ['6789951'] 2022-04-15T07:03:50.134 INFO:scrape:suites: ['objectstore/filestore-xfs', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/cfuse_workunit_kernel_untar_build', 'thrashosds-health', 'whitelist_health}'] 2022-04-15T07:03:50.134 INFO:scrape: 2022-04-15T07:03:50.135 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 9 Fail ================================================================= [6789945] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/rados_api_tests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789945/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789945/ SELinux denials found on ubuntu@smithi122.front.sepia.ceph.com: ['type=AVC msg=audit(1649866032.742:42): avc: denied { node_bind } for pid=1602 comm="ping" saddr=172.21.15.122 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1649865832.067:42): avc: denied { node_bind } for pid=1890 comm="ping" saddr=172.21.15.122 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6789947] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/readwrite thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:27:14 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789947/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789947/ Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json' [6789948] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/snaps-few-objects thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:27:54 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789948/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789948/ SELinux denials found on ubuntu@smithi085.front.sepia.ceph.com: ['type=AVC msg=audit(1649976403.760:41): avc: denied { node_bind } for pid=1693 comm="ping" saddr=172.21.15.85 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1649976788.231:42): avc: denied { node_bind } for pid=1600 comm="ping" saddr=172.21.15.85 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6789951] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:34:47 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789951/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789951/ SELinux denials found on ubuntu@smithi138.front.sepia.ceph.com: ['type=AVC msg=audit(1649976288.980:41): avc: denied { node_bind } for pid=1665 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1649976790.914:43): avc: denied { node_bind } for pid=1588 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1649976943.730:41): avc: denied { node_bind } for pid=1594 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1649976445.669:43): avc: denied { node_bind } for pid=1596 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6789954] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:15:20 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789954/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789954/ SELinux denials found on ubuntu@smithi165.front.sepia.ceph.com: ['type=AVC msg=audit(1649976081.491:41): avc: denied { node_bind } for pid=1886 comm="ping" saddr=172.21.15.165 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6789957] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789957/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789957/ SELinux denials found on ubuntu@smithi176.front.sepia.ceph.com: ['type=AVC msg=audit(1650005991.712:41): avc: denied { node_bind } for pid=1809 comm="ping" saddr=172.21.15.176 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] Pass ================================================================= [6789943] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:15:15 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789943/ [6789944] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:10:19 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789944/ [6789946] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/radosbench thrashosds-health whitelist_health} time: 01:22:30 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789946/ [6789949] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:30:19 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789949/ [6789950] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:17:53 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789950/ [6789952] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 00:28:24 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789952/ [6789953] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 00:32:25 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789953/ [6789955] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:20:47 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789955/ [6789956] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:13:38 info: http://pulpito.ceph.com/teuthology-2022-04-13_12:17:03-powercycle-pacific-distro-default-smithi/6789956/