2023-01-09T23:47:05.133 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-09T23:47:05.134 INFO:teuthology.results:subset: '111/120000' 2023-01-09T23:47:05.134 INFO:teuthology.results:seed: '9889' 2023-01-10T00:09:34.038 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-10T00:09:34.041 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-01-10T01:28:39.713 INFO:teuthology.results:Tests finished! gathering results... 2023-01-10T01:28:41.014 INFO:scrape:Found 15 jobs 2023-01-10T01:28:41.643 INFO:scrape:Found 3 distinct failure reasons 2023-01-10T01:28:41.644 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi173.front.sepia.ceph.com: ['type=AVC msg=audit(1673310472.960:46): avc: denied { node_bind } for pid=1616 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1673310677.910:48): avc: denied { node_bind } for pid=1624 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1673311210.284:48): avc: denied { node_bind } for pid=1616 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1673311051.054:48): avc: denied { node_bind } for pid=1606 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-01-10T01:28:41.645 INFO:scrape:2 jobs: ['7132429', '7132426'] 2023-01-10T01:28:41.645 INFO:scrape:suites intersection: ['ignorelist_health', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/rhel_8', 'thrashosds-health}'] 2023-01-10T01:28:41.646 INFO:scrape:suites union: ['ignorelist_health', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/rhel_8', 'tasks/radosbench', 'tasks/snaps-many-objects', 'thrashosds-health}'] 2023-01-10T01:28:41.646 INFO:scrape: 2023-01-10T01:28:41.646 INFO:scrape:Failure: {'smithi097.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} 2023-01-10T01:28:41.647 INFO:scrape:1 jobs: ['7132423'] 2023-01-10T01:28:41.647 INFO:scrape:suites: ['ignorelist_health', 'objectstore/filestore-xfs', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/rhel_8', 'tasks/cfuse_workunit_suites_pjd', 'thrashosds-health}'] 2023-01-10T01:28:41.648 INFO:scrape: 2023-01-10T01:28:41.648 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi144.front.sepia.ceph.com: ['type=AVC msg=audit(1673310418.075:48): avc: denied { node_bind } for pid=1623 comm="ping" saddr=172.21.15.144 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-01-10T01:28:41.648 INFO:scrape:2 jobs: ['7132417', '7132420'] 2023-01-10T01:28:41.649 INFO:scrape:suites intersection: ['ignorelist_health', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/rhel_8', 'thrashosds-health}'] 2023-01-10T01:28:41.649 INFO:scrape:suites union: ['ignorelist_health', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/rhel_8', 'tasks/cfuse_workunit_kernel_untar_build', 'tasks/cfuse_workunit_suites_fsstress', 'thrashosds-health}'] 2023-01-10T01:28:41.650 INFO:scrape: 2023-01-10T01:28:41.651 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/ failed: 4 dead: 1 running: 0 waiting: 0 queued: 0 passed: 10 Fail ================================================================= [7132417] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health} ----------------------------------------------------------------- time: 00:41:02 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132417/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132417/ SELinux denials found on ubuntu@smithi144.front.sepia.ceph.com: ['type=AVC msg=audit(1673310418.075:48): avc: denied { node_bind } for pid=1623 comm="ping" saddr=172.21.15.144 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [7132420] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health} ----------------------------------------------------------------- time: 00:17:21 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132420/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132420/ SELinux denials found on ubuntu@smithi120.front.sepia.ceph.com: ['type=AVC msg=audit(1673309652.446:46): avc: denied { node_bind } for pid=1732 comm="ping" saddr=172.21.15.120 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [7132426] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8 tasks/radosbench thrashosds-health} ----------------------------------------------------------------- time: 01:16:04 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132426/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132426/ SELinux denials found on ubuntu@smithi138.front.sepia.ceph.com: ['type=AVC msg=audit(1673312652.161:47): avc: denied { node_bind } for pid=1617 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1673311497.967:46): avc: denied { node_bind } for pid=1625 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1673312425.739:46): avc: denied { node_bind } for pid=1624 comm="ping" saddr=172.21.15.138 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [7132429] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8 tasks/snaps-many-objects thrashosds-health} ----------------------------------------------------------------- time: 00:29:04 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132429/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132429/ SELinux denials found on ubuntu@smithi173.front.sepia.ceph.com: ['type=AVC msg=audit(1673310472.960:46): avc: denied { node_bind } for pid=1616 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1673310677.910:48): avc: denied { node_bind } for pid=1624 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1673311210.284:48): avc: denied { node_bind } for pid=1616 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1673311051.054:48): avc: denied { node_bind } for pid=1606 comm="ping" saddr=172.21.15.173 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] Dead ================================================================= [7132423] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/filestore-xfs powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_pjd thrashosds-health} ----------------------------------------------------------------- time: 00:06:50 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132423/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132423/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa1100e4b62348d38aea9c0fcb1174ad {'smithi097.front.sepia.ceph.com': {'attempts': 12, 'censored': "the output has been hidden due to the fact that 'no_log: true' was specified for this result", 'changed': True}} Pass ================================================================= [7132415] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-many-objects thrashosds-health} time: 00:25:46 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132415/ [7132416] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health} time: 00:21:18 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132416/ [7132418] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_misc thrashosds-health} time: 00:50:00 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132418/ [7132419] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health} time: 00:28:05 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132419/ [7132421] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsx thrashosds-health} time: 00:24:11 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132421/ [7132422] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} time: 00:17:33 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132422/ [7132424] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_truncate_delay thrashosds-health} time: 00:11:50 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132424/ [7132425] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/rados_api_tests thrashosds-health} time: 00:36:29 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132425/ [7132427] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/readwrite thrashosds-health} time: 00:14:55 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132427/ [7132428] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/snaps-few-objects thrashosds-health} time: 00:28:44 info: http://pulpito.ceph.com/yuriw-2023-01-04_17:53:17-powercycle-pacific_16.2.11_RC4-distro-default-smithi/7132428/