2021-10-13T04:18:35.510 INFO:root:teuthology version: 1.1.0-6f40c4ca 2021-10-13T04:18:35.512 INFO:teuthology.results:subset: '111/120000' 2021-10-13T04:18:35.513 INFO:teuthology.results:seed: '1967' 2021-10-13T04:30:59.494 INFO:root:teuthology version: 1.1.0-6f40c4ca 2021-10-13T04:30:59.499 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-10-13T04:58:01.428 INFO:teuthology.results:Tests finished! gathering results... 2021-10-13T04:58:01.654 INFO:scrape:Found 6 jobs 2021-10-13T04:58:02.664 INFO:scrape:Found 4 distinct failure reasons 2021-10-13T04:58:02.665 INFO:scrape:Failure: 'in ' requires string as left operand, not NoneType 2021-10-13T04:58:02.665 INFO:scrape:3 jobs: ['6433984', '6433985', '6433982'] 2021-10-13T04:58:02.666 INFO:scrape:suites intersection: ['conf/{client', 'k-testing}', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-10-13T04:58:02.666 INFO:scrape:suites union: ['clusters/1-mds-1-client', 'clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kcephfs/thrash/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'objectstore-ec/filestore-xfs', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/centos_latest', 'overrides/{frag_enable', 'tasks/client-recovery}', 'thrash-health-whitelist', 'thrashers/default', 'whitelist_health', 'whitelist_wrongly_marked_down}', 'workloads/kclient_workunit_suites_ffsb}', 'workloads/kclient_workunit_suites_iozone}'] 2021-10-13T04:58:02.667 INFO:scrape: 2021-10-13T04:58:02.667 INFO:scrape:Failure: Test failure: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2021-10-13T04:58:02.668 INFO:scrape:1 jobs: ['6433987'] 2021-10-13T04:58:02.668 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-comp-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/mds-full}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-10-13T04:58:02.669 INFO:scrape: 2021-10-13T04:58:02.669 INFO:scrape:Failure: Test failure: test_dirfrag_limit (tasks.cephfs.test_strays.TestStrays) 2021-10-13T04:58:02.669 INFO:scrape:1 jobs: ['6433981'] 2021-10-13T04:58:02.670 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'k-testing}', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-bitmap', 'osd-asserts', 'osd}', 'overrides/{distro/testing/{flavor/ubuntu_latest', 'overrides/{frag_enable', 'tasks/strays}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-10-13T04:58:02.670 INFO:scrape: 2021-10-13T04:58:02.671 INFO:scrape:Failure: {'Failure object was': {'smithi063.front.sepia.ceph.com': {'ansible_facts': {}, 'msg': 'The following modules failed to execute: setup\\n', 'failed_modules': {'setup': {'failed': True, 'module_stdout': '', 'module_stderr': '', 'msg': 'MODULE FAILURE\\nSee stdout/stderr for the exact error', 'rc': -13}}, '_ansible_verbose_override': True, '_ansible_no_log': False, 'changed': False}}, 'Traceback (most recent call last)': 'File "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/callback_plugins/failure_log.py", line 44, in log_failure log.error(yaml.safe_dump(failure)) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 306, in safe_dump return dump_all([data], stream, Dumper=SafeDumper, **kwds) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/__init__.py", line 278, in dump_all dumper.represent(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 27, in represent node = self.represent_data(data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 118, in represent_mapping node_value = self.represent_data(item_value) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 48, in represent_data node = self.yaml_representers[data_types[0]](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 207, in represent_dict return self.represent_mapping(\'tag:yaml.org,2002:map\', data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 117, in represent_mapping node_key = self.represent_data(item_key) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 58, in represent_data node = self.yaml_representers[None](self, data) File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/virtualenv/lib/python3.6/site-packages/yaml/representer.py", line 231, in represent_undefined raise RepresenterError("cannot represent an object", data)', 'yaml.representer.RepresenterError': "('cannot represent an object', 'failed')"} 2021-10-13T04:58:02.671 INFO:scrape:1 jobs: ['6433983'] 2021-10-13T04:58:02.672 INFO:scrape:suites: ['clusters/1-mds-4-client', 'conf/{client', 'kcephfs/recovery/{begin', 'kclient/{mount', 'log-config', 'mds', 'mon', 'ms-die-on-skipped}}', 'objectstore-ec/bluestore-ec-root', 'osd-asserts', 'osd}', 'overrides/{distro/stock/{k-stock', 'overrides/{frag_enable', 'rhel_8}', 'tasks/client-limits}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2021-10-13T04:58:02.672 INFO:scrape: