2022-09-28T12:17:12.028 INFO:root:teuthology version: 1.1.1.dev424+ga773b061 2022-09-28T12:17:12.029 INFO:teuthology.results:subset: '1717/9999' 2022-09-28T12:17:12.029 INFO:teuthology.results:seed: '4708' 2022-09-28T12:18:03.451 INFO:root:teuthology version: 1.1.1.dev424+ga773b061 2022-09-28T12:18:03.454 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-09-28T13:35:08.333 INFO:teuthology.results:Tests finished! gathering results... 2022-09-28T13:35:08.874 INFO:scrape:Found 15 jobs 2022-09-28T13:35:09.011 INFO:scrape:Found 2 distinct failure reasons 2022-09-28T13:35:09.012 INFO:scrape:Dead: b"TypeError: argument of type 'NoneType' is not iterable" 2022-09-28T13:35:09.012 INFO:scrape:1 jobs: ['7046621'] 2022-09-28T13:35:09.013 INFO:scrape:suites: ['objectstore/bluestore-bitmap', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/centos_8', 'tasks/cfuse_workunit_suites_pjd', 'thrashosds-health', 'whitelist_health}'] 2022-09-28T13:35:09.013 INFO:scrape: 2022-09-28T13:35:09.013 INFO:scrape:Failure: {'smithi132.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['hwclock', '--systohc'], 'delta': '0:00:00.001945', 'end': '2022-09-28 12:25:47.438175', 'invocation': {'module_args': {'_raw_params': 'hwclock --systohc', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-09-28 12:25:47.436230', 'stderr': 'hwclock: Cannot access the Hardware Clock via any known method.\nhwclock: Use the --verbose option to see the details of our search for an access method.', 'stderr_lines': ['hwclock: Cannot access the Hardware Clock via any known method.', 'hwclock: Use the --verbose option to see the details of our search for an access method.'], 'stdout': '', 'stdout_lines': []}, 'smithi167.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['hwclock', '--systohc'], 'delta': '0:00:00.002120', 'end': '2022-09-28 12:25:48.946072', 'invocation': {'module_args': {'_raw_params': 'hwclock --systohc', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-09-28 12:25:48.943952', 'stderr': 'hwclock: Cannot access the Hardware Clock via any known method.\nhwclock: Use the --verbose option to see the details of our search for an access method.', 'stderr_lines': ['hwclock: Cannot access the Hardware Clock via any known method.', 'hwclock: Use the --verbose option to see the details of our search for an access method.'], 'stdout': '', 'stdout_lines': []}} 2022-09-28T13:35:09.014 INFO:scrape:1 jobs: ['7046620'] 2022-09-28T13:35:09.014 INFO:scrape:suites: ['objectstore/filestore-xfs', 'powercycle/default', 'powercycle/osd/{clusters/3osd-1per-target', 'supported-all-distro/ubuntu_latest', 'tasks/cfuse_workunit_suites_fsync', 'thrashosds-health', 'whitelist_health}'] 2022-09-28T13:35:09.015 INFO:scrape: 2022-09-28T13:35:09.016 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/ failed: 0 dead: 2 running: 0 waiting: 0 queued: 0 passed: 13 Dead ================================================================= [7046620] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_fsync thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:03:47 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046620/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046620/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0d8c743bed14bde822ebe307fc6aa2b {'smithi132.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['hwclock', '--systohc'], 'delta': '0:00:00.001945', 'end': '2022-09-28 12:25:47.438175', 'invocation': {'module_args': {'_raw_params': 'hwclock --systohc', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-09-28 12:25:47.436230', 'stderr': 'hwclock: Cannot access the Hardware Clock via any known method.\nhwclock: Use the --verbose option to see the details of our search for an access method.', 'stderr_lines': ['hwclock: Cannot access the Hardware Clock via any known method.', 'hwclock: Use the --verbose option to see the details of our search for an access method.'], 'stdout': '', 'stdout_lines': []}, 'smithi167.front.sepia.ceph.com': {'_ansible_no_log': False, 'changed': True, 'cmd': ['hwclock', '--systohc'], 'delta': '0:00:00.002120', 'end': '2022-09-28 12:25:48.946072', 'invocation': {'module_args': {'_raw_params': 'hwclock --systohc', '_uses_shell': False, 'argv': None, 'chdir': None, 'creates': None, 'executable': None, 'removes': None, 'stdin': None, 'stdin_add_newline': True, 'strip_empty_ends': True, 'warn': True}}, 'msg': 'non-zero return code', 'rc': 1, 'start': '2022-09-28 12:25:48.943952', 'stderr': 'hwclock: Cannot access the Hardware Clock via any known method.\nhwclock: Use the --verbose option to see the details of our search for an access method.', 'stderr_lines': ['hwclock: Cannot access the Hardware Clock via any known method.', 'hwclock: Use the --verbose option to see the details of our search for an access method.'], 'stdout': '', 'stdout_lines': []}} [7046621] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_pjd thrashosds-health whitelist_health} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046621/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046621/ Pass ================================================================= [7046609] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_8 tasks/rados_api_tests thrashosds-health whitelist_health} time: 00:33:41 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046609/ [7046610] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/radosbench thrashosds-health whitelist_health} time: 01:09:44 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046610/ [7046611] powercycle/osd/{clusters/3osd-1per-target objectstore/filestore-xfs powercycle/default supported-all-distro/ubuntu_latest tasks/readwrite thrashosds-health whitelist_health} time: 00:15:43 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046611/ [7046612] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-bitmap powercycle/default supported-all-distro/centos_8 tasks/snaps-few-objects thrashosds-health whitelist_health} time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046612/ [7046613] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/snaps-many-objects thrashosds-health whitelist_health} time: 00:27:23 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046613/ [7046614] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_latest tasks/admin_socket_objecter_requests thrashosds-health whitelist_health} time: 00:15:01 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046614/ [7046615] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_kernel_untar_build thrashosds-health whitelist_health} time: 00:41:02 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046615/ [7046616] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-zstd powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_misc thrashosds-health whitelist_health} time: 00:26:21 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046616/ [7046617] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-hybrid powercycle/default supported-all-distro/ubuntu_latest tasks/cfuse_workunit_suites_ffsb thrashosds-health whitelist_health} time: 00:30:51 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046617/ [7046618] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-low-osd-mem-target powercycle/default supported-all-distro/centos_8 tasks/cfuse_workunit_suites_fsstress thrashosds-health whitelist_health} time: 00:15:34 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046618/ [7046619] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsx thrashosds-health whitelist_health} time: 00:23:16 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046619/ [7046622] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-lz4 powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_truncate_delay thrashosds-health whitelist_health} time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046622/ [7046623] powercycle/osd/{clusters/3osd-1per-target objectstore/bluestore-comp-snappy powercycle/default supported-all-distro/ubuntu_latest tasks/rados_api_tests thrashosds-health whitelist_health} time: 00:32:12 info: http://pulpito.ceph.com/teuthology-2022-09-28_12:17:02-powercycle-pacific-distro-default-smithi/7046623/