2023-02-03T12:03:11.161 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-03T12:03:11.178 INFO:teuthology.results:subset: '111/120000' 2023-02-03T12:03:11.178 INFO:teuthology.results:seed: '9447' 2023-02-03T12:42:35.224 INFO:root:teuthology version: 0.0.1.dev37+g00690ec 2023-02-03T12:42:35.250 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2023-02-03T14:01:40.908 INFO:teuthology.results:Tests finished! gathering results... 2023-02-03T14:01:41.885 INFO:scrape:Found 15 jobs 2023-02-03T14:01:42.667 INFO:scrape:Found 2 distinct failure reasons 2023-02-03T14:01:42.668 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi023.front.sepia.ceph.com: ['type=AVC msg=audit(1675427129.800:45): avc: denied { node_bind } for pid=1680 comm="ping" saddr=172.21.15.23 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-02-03T14:01:42.669 INFO:scrape:5 jobs: ['7145731', '7145737', '7145740', '7145743', '7145734'] 2023-02-03T14:01:42.669 INFO:scrape:suites intersection: ['ignorelist_health', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/rhel_8', 'thrashosds-health}'] 2023-02-03T14:01:42.670 INFO:scrape:suites union: ['ignorelist_health', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-stupid', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/rhel_8', 'tasks/admin_socket_objecter_requests', 'tasks/cfuse_workunit_suites_ffsb', 'tasks/cfuse_workunit_suites_fsync', 'tasks/rados_api_tests', 'tasks/snaps-few-objects', 'thrashosds-health}'] 2023-02-03T14:01:42.670 INFO:scrape: 2023-02-03T14:01:42.671 INFO:scrape:Timeout 120 running ceph --cluster ceph pg dump --format=json 2023-02-03T14:01:42.671 INFO:scrape:1 jobs: ['7145736'] 2023-02-03T14:01:42.671 INFO:scrape:suites: ['ignorelist_health', 'objectstore/bluestore-low-osd-mem-target', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/cfuse_workunit_suites_fsx', 'thrashosds-health}'] 2023-02-03T14:01:42.672 INFO:scrape: 2023-02-03T14:01:42.673 INFO:teuthology.results:Sending results to yweinstein@radhat.com: Test Run: yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/ failed: 6 dead: 0 running: 0 waiting: 0 queued: 0 passed: 9 Fail ================================================================= [7145731] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/admin_socket_objecter_requests thrashosds-health} ----------------------------------------------------------------- time: 00:16:57 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145731/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145731/ SELinux denials found on ubuntu@smithi023.front.sepia.ceph.com: ['type=AVC msg=audit(1675427129.800:45): avc: denied { node_bind } for pid=1680 comm="ping" saddr=172.21.15.23 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [7145734] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health} ----------------------------------------------------------------- time: 00:30:43 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145734/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145734/ SELinux denials found on ubuntu@smithi062.front.sepia.ceph.com: ['type=AVC msg=audit(1675428161.977:44): avc: denied { node_bind } for pid=3128 comm="ping" saddr=172.21.15.62 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [7145736] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsx thrashosds-health} ----------------------------------------------------------------- time: 00:34:53 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145736/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145736/ Command failed on smithi039 with status 124: 'sudo adjust-ulimits ceph- coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' [7145737] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} ----------------------------------------------------------------- time: 00:17:10 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145737/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145737/ SELinux denials found on ubuntu@smithi191.front.sepia.ceph.com: ['type=AVC msg=audit(1675428089.977:44): avc: denied { node_bind } for pid=1847 comm="ping" saddr=172.21.15.191 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [7145740] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/rhel_8 tasks/rados_api_tests thrashosds-health} ----------------------------------------------------------------- time: 00:34:25 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145740/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145740/ SELinux denials found on ubuntu@smithi042.front.sepia.ceph.com: ['type=AVC msg=audit(1675429614.711:44): avc: denied { node_bind } for pid=1565 comm="ping" saddr=172.21.15.42 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1675429441.939:44): avc: denied { node_bind } for pid=1581 comm="ping" saddr=172.21.15.42 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [7145743] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-all-distro/rhel_8 tasks/snaps-few-objects thrashosds-health} ----------------------------------------------------------------- time: 00:28:02 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145743/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145743/ SELinux denials found on ubuntu@smithi090.front.sepia.ceph.com: ['type=AVC msg=audit(1675429918.426:44): avc: denied { node_bind } for pid=1740 comm="ping" saddr=172.21.15.90 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] Pass ================================================================= [7145730] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_8 tasks/snaps-many-objects thrashosds-health} time: 00:27:42 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145730/ [7145732] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_kernel_untar_build thrashosds-health} time: 00:52:19 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145732/ [7145733] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_misc thrashosds-health} time: 00:47:44 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145733/ [7145735] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-hybrid powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health} time: 00:15:10 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145735/ [7145738] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-bitmap powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_pjd thrashosds-health} time: 00:15:24 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145738/ [7145739] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health} time: 00:13:16 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145739/ [7145741] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_latest tasks/radosbench thrashosds-health} time: 01:12:12 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145741/ [7145742] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/centos_8 tasks/readwrite thrashosds-health} time: 00:19:38 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145742/ [7145744] powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-many-objects thrashosds-health} time: 00:31:10 info: http://pulpito.ceph.com/yuriw-2023-02-02_19:29:06-powercycle-wip-yuri6-testing-2023-01-26-0941-distro-default-smithi/7145744/