2022-12-23T07:38:38.938 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-23T07:38:38.938 INFO:teuthology.results:subset: '1/3' 2022-12-23T07:38:38.938 INFO:teuthology.results:seed: '9226' 2022-12-23T07:39:47.819 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2022-12-23T07:39:47.822 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-12-23T10:37:01.078 INFO:teuthology.results:Tests finished! gathering results... 2022-12-23T10:37:10.832 INFO:scrape:Found 59 jobs 2022-12-23T10:37:11.323 WARNING:scrape:Not-understood crash indication 2022-12-23T08:55:01.638 INFO:tasks.rgw.c1.client.0.smithi093.stderr:daemon-helper: command crashed with signal 6 2022-12-23T10:37:11.324 WARNING:scrape:Not-understood crash indication 2022-12-23T10:02:54.749 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi093.stderr: INFO: daemon-helper: command crashed with signal 6 2022-12-23T10:37:11.324 WARNING:scrape:Not-understood crash indication 2022-12-23T10:37:11.458 WARNING:scrape:Not-understood crash indication 2022-12-23T08:55:01.638 INFO:tasks.rgw.c1.client.0.smithi093.stderr:daemon-helper: command crashed with signal 6 2022-12-23T10:37:11.459 WARNING:scrape:Not-understood crash indication 2022-12-23T10:02:54.749 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi093.stderr: INFO: daemon-helper: command crashed with signal 6 2022-12-23T10:37:11.459 WARNING:scrape:Not-understood crash indication 2022-12-23T10:37:11.594 WARNING:scrape:Not-understood crash indication 2022-12-23T08:55:01.638 INFO:tasks.rgw.c1.client.0.smithi093.stderr:daemon-helper: command crashed with signal 6 2022-12-23T10:37:11.595 WARNING:scrape:Not-understood crash indication 2022-12-23T10:02:54.749 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi093.stderr: INFO: daemon-helper: command crashed with signal 6 2022-12-23T10:37:11.595 WARNING:scrape:Not-understood crash indication 2022-12-23T10:37:12.092 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuvalif-2022-12-23_07:38:27-rgw-wip-yuval-test-main-distro-default-smithi/7126236/teuthology.log 2022-12-23T10:37:12.539 WARNING:scrape:Not-understood crash indication 2022-12-23T08:40:38.860 INFO:tasks.rgw.c1.client.0.smithi016.stderr:daemon-helper: command crashed with signal 6 2022-12-23T10:37:12.540 WARNING:scrape:Not-understood crash indication 2022-12-23T09:46:22.634 INFO:tasks.rgw_multisite_tests:tasks.rgw.c1.client.0.smithi016.stderr: INFO: daemon-helper: command crashed with signal 6 2022-12-23T10:37:12.540 WARNING:scrape:Not-understood crash indication 2022-12-23T10:37:12.602 INFO:scrape:Found 4 distinct failure reasons 2022-12-23T10:37:12.603 INFO:scrape:Failure: rgw multisite test failures 2022-12-23T10:37:12.603 INFO:scrape:2 jobs: ['7126213', '7126244'] 2022-12-23T10:37:12.603 INFO:scrape:suites intersection: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'rgw/multisite/{clusters', 'tasks/test_multi}'] 2022-12-23T10:37:12.603 INFO:scrape:suites union: ['frontend/beast', 'ignore-pg-availability', 'notify', 'omap_limits', 'overrides', 'realms/three-zones', 'realms/two-zonegroup', 'rgw/multisite/{clusters', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'tasks/test_multi}'] 2022-12-23T10:37:12.603 INFO:scrape: 2022-12-23T10:37:12.604 INFO:scrape:Failure: Command failed on smithi061 with status 1: 'cd /home/ubuntu/cephtest/tempest && /home/ubuntu/cephtest/tox-venv/bin/tox -e venv --notest' 2022-12-23T10:37:12.604 INFO:scrape:1 jobs: ['7126218'] 2022-12-23T10:37:12.604 INFO:scrape:suites: ['frontend/beast', 'overrides', 'rgw/tempest/{clusters/fixed-1', 'tasks/rgw_tempest', 'ubuntu_latest}'] 2022-12-23T10:37:12.604 INFO:scrape: 2022-12-23T10:37:12.604 INFO:scrape:Dead: None 2022-12-23T10:37:12.604 INFO:scrape:2 jobs: ['7126236', '7126246'] 2022-12-23T10:37:12.604 INFO:scrape: 2022-12-23T10:37:12.604 INFO:scrape:Failure: {'smithi038.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.342913', 'end': '2022-12-23 08:04:44.889443', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-23 08:04:40.546530', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2506 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2506 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}, 'smithi119.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['cpan', 'Amazon::S3'], 'delta': '0:00:04.283189', 'end': '2022-12-23 08:04:45.000476', 'invocation': {'module_args': {'_raw_params': 'cpan Amazon::S3', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 25, 'start': '2022-12-23 08:04:40.717287', 'stderr': '', 'stderr_lines': [], 'stdout': "Loading internal logger. Log::Log4perl recommended for better logging\nReading '/home/ubuntu/.cpan/Metadata'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz\nReading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz\nReading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'\n Database was generated on Fri, 12 Feb 2016 02:17:02 GMT\nWarning: This index file is 2506 days old.\n Please check the host you chose as your CPAN mirror for staleness.\n I'll continue but problems seem likely to happen.\x07\n............................................................................DONE\nFetching with LWP:\nhttp://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz\nReading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'\nDONE\nWriting /home/ubuntu/.cpan/Metadata\nRunning install for module 'Amazon::S3'\n\nWarning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.\n\nThe cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.\nProceed nonetheless? [no] no\nAborted.", 'stdout_lines': ['Loading internal logger. Log::Log4perl recommended for better logging', "Reading '/home/ubuntu/.cpan/Metadata'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/authors/01mailrc.txt.gz', "Reading '/home/ubuntu/.cpan/sources/authors/01mailrc.txt.gz'", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/02packages.details.txt.gz', "Reading '/home/ubuntu/.cpan/sources/modules/02packages.details.txt.gz'", ' Database was generated on Fri, 12 Feb 2016 02:17:02 GMT', 'Warning: This index file is 2506 days old.', ' Please check the host you chose as your CPAN mirror for staleness.', " I'll continue but problems seem likely to happen.\x07", '............................................................................DONE', 'Fetching with LWP:', 'http://apt-mirror.sepia.ceph.com/CPAN/modules/03modlist.data.gz', "Reading '/home/ubuntu/.cpan/sources/modules/03modlist.data.gz'", 'DONE', 'Writing /home/ubuntu/.cpan/Metadata', "Running install for module 'Amazon::S3'", '', "Warning: checksum file '/home/ubuntu/.cpan/sources/authors/id/T/TI/TIMA/CHECKSUMS' not conforming.", '', "The cksum does not contain the key 'cpan_path' for 'Amazon-S3-0.45.tar.gz'.", 'Proceed nonetheless? [no] no', 'Aborted.']}} 2022-12-23T10:37:12.605 INFO:scrape:2 jobs: ['7126242', '7126210'] 2022-12-23T10:37:12.605 INFO:scrape:suites intersection: ['overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2022-12-23T10:37:12.605 INFO:scrape:suites union: ['hadoop/default', 'hadoop/v32', 'overrides', 'rgw/hadoop-s3a/{clusters/fixed-2', 's3a-hadoop}'] 2022-12-23T10:37:12.605 INFO:scrape: