2022-05-02T19:47:24.389 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-02T19:47:24.389 INFO:teuthology.results:subset: '14157/100000' 2022-05-02T19:47:24.389 INFO:teuthology.results:seed: '4229' 2022-05-02T20:15:47.802 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-02T20:15:47.837 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-05-02T21:07:51.700 INFO:teuthology.results:Tests finished! gathering results... 2022-05-02T21:07:52.533 INFO:scrape:Found 15 jobs 2022-05-02T21:07:54.926 INFO:scrape:Found 1 distinct failure reasons 2022-05-02T21:07:54.926 INFO:scrape:Failure: SELinux denials found on ubuntu@smithi117.front.sepia.ceph.com: ['type=AVC msg=audit(1651521942.716:42): avc: denied { node_bind } for pid=1988 comm="ping" saddr=172.21.15.117 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2022-05-02T21:07:54.927 INFO:scrape:5 jobs: ['6808626', '6808638', '6808635', '6808629', '6808632'] 2022-05-02T21:07:54.927 INFO:scrape:suites intersection: ['powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'thrashosds-health', 'whitelist_health}'] 2022-05-02T21:07:54.927 INFO:scrape:suites union: ['objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'objectstore/filestore-xfs', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/admin_socket_objecter_requests', 'tasks/cfuse_workunit_suites_ffsb', 'tasks/cfuse_workunit_suites_fsx', 'tasks/cfuse_workunit_suites_truncate_delay', 'tasks/readwrite', 'thrashosds-health', 'whitelist_health}'] 2022-05-02T21:07:54.927 INFO:scrape: 2022-05-02T21:07:54.928 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/ failed: 5 dead: 0 running: 0 waiting: 0 queued: 0 passed: 10 Fail ================================================================= [6808626] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:16:24 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808626/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808626/ SELinux denials found on ubuntu@smithi117.front.sepia.ceph.com: ['type=AVC msg=audit(1651521942.716:42): avc: denied { node_bind } for pid=1988 comm="ping" saddr=172.21.15.117 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6808629] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:10:50 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808629/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808629/ SELinux denials found on ubuntu@smithi119.front.sepia.ceph.com: ['type=AVC msg=audit(1651522426.913:41): avc: denied { node_bind } for pid=1910 comm="ping" saddr=172.21.15.119 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6808632] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/centos_8 tasks/readwrite thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808632/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808632/ SELinux denials found on ubuntu@smithi134.front.sepia.ceph.com: ['type=AVC msg=audit(1651522912.164:42): avc: denied { node_bind } for pid=1960 comm="ping" saddr=172.21.15.134 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6808635] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/centos_8 tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:13:15 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808635/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808635/ SELinux denials found on ubuntu@smithi146.front.sepia.ceph.com: ['type=AVC msg=audit(1651523157.531:42): avc: denied { node_bind } for pid=1658 comm="ping" saddr=172.21.15.146 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] [6808638] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:26:02 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808638/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808638/ SELinux denials found on ubuntu@smithi171.front.sepia.ceph.com: ['type=AVC msg=audit(1651523622.850:42): avc: denied { node_bind } for pid=1951 comm="ping" saddr=172.21.15.171 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1', 'type=AVC msg=audit(1651524094.905:42): avc: denied { node_bind } for pid=1626 comm="ping" saddr=172.21.15.171 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] Pass ================================================================= [6808624] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 00:26:51 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808624/ [6808625] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:18:55 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808625/ [6808627] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} time: 00:16:35 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808627/ [6808628] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808628/ [6808630] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/rhel_8 tasks/rados_api_tests thrashosds-health whitelist_health} time: 00:33:03 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808630/ [6808631] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/ubuntu_latest tasks/radosbench thrashosds-health whitelist_health} time: 00:57:05 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808631/ [6808633] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/rhel_8 tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:27:00 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808633/ [6808634] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/ubuntu_latest tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:28:51 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808634/ [6808636] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 00:30:11 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808636/ [6808637] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 00:33:16 info: http://pulpito.ceph.com/teuthology-2022-04-27_11:15:03-powercycle-quincy-distro-default-smithi/6808637/ 2022-05-02T21:07:54.938 ERROR:teuthology.results:error generating memo/results Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/results.py", line 34, in main File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/results.py", line 80, in results File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/teuthology/results.py", line 93, in email_results File "/usr/lib/python3.6/smtplib.py", line 251, in __init__ (code, msg) = self.connect(host, port) File "/usr/lib/python3.6/smtplib.py", line 336, in connect self.sock = self._get_socket(host, port, self.timeout) File "/usr/lib/python3.6/smtplib.py", line 307, in _get_socket self.source_address) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/gevent/socket.py", line 88, in create_connection File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/gevent/_socketcommon.py", line 247, in getaddrinfo File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/gevent/hub.py", line 841, in _get_resolver File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/gevent/hub.py", line 837, in resolver_class File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/gevent/_config.py", line 50, in getter File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/gevent/_config.py", line 146, in get File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/gevent/_config.py", line 248, in validate File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/gevent/_config.py", line 223, in _import_one_of File "/home/teuthworker/src/git.ceph.com_git_teuthology_fd5c31669e51177d3c57bc0420279c5d1e944497/virtualenv/lib/python3.6/site-packages/gevent/_config.py", line 237, in _import_one File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "", line 994, in _gcd_import File "", line 971, in _find_and_load File "", line 941, in _find_and_load_unlocked File "", line 219, in _call_with_frames_removed File "", line 994, in _gcd_import File "", line 971, in _find_and_load File "", line 953, in _find_and_load_unlocked ModuleNotFoundError: No module named 'gevent.resolver'